The Aldrich family were close friends of Henry L. Pierce, former mayor of Boston and chocolate magnate (he made a lot of money from the chocolate business). When Pierce died death in 1896, he willed the Aldriches his home in Canton, Massachusetts.