After graduating from Boston Latin School, he attended the Boston University College of Liberal Arts as a freshman during 1883–84, but, unable to obtain instruction in Sanskrit from that institution, transferred to Harvard University for his sophomore year. He graduated from Harvard and married Mary Smith, who became a notable art historian in her own right. Mary was the sister of Logan Pearsall Smith and of Alys Pearsall Smith, the first wife of Bertrand Russell. Mary had previously been married to barrister Frank Costelloe. Bernard Berenson was also involved in a long relationship with Belle da Costa Greene. Samuels (1987) mentions Mary's "reluctant acceptance (at times)" of this relationship.