The children grew up in and committed to the abolition movement. Robert, named for his father's former boss and mentor, was a vigorous anti-slavery activist. William studied at the abolitionist Oneida Institute. Sisters Harriet and Sarah Louisa married the prominent abolitionist brothers Robert Purvis and Joseph Purvis, respectively. Educated at Amherst College, they were sons of a British immigrant and his wife, a free woman of color. They used their great wealth in lives of public service. Margaretta was a lifelong educator and became an officer of the Philadelphia Female Anti-Slavery Society in 1845.