The couple had six children: Julia Romana Howe (1844–1886), who married Michael Anagnos, a Greek scholar who succeeded Howe as director of the Perkins Institute; Florence Marion Howe (1845–1922), a Pulitzer prize-winning author, wrote a well-known treatise on manners and married David Prescott Hall, a lawyer; Henry Marion Howe (1848–1922), a metallurgist who lived in New York; Laura Elizabeth Howe (1850–1943), a Pulitzer prize-winning author, married Henry Richards and lived in Maine; Maud Howe (1854–1948), a Pulitzer prize-winning author, married John Elliott, an English muralist and illustrator; and Samuel Gridley Howe, Jr. (1858–1863), who died at age five.