When Boulton was widowed in 1783 he was left with the care of his two teenage children. Neither his son Matthew Robinson Boulton nor his daughter Anne enjoyed robust health; the younger Matthew was often ill and was a poor student who was shuttled from school to school until he joined his father's business in 1790; Anne suffered from a diseased leg that prevented her from enjoying a full life. Despite his lengthy absences on business, Boulton cared deeply for his family. He wrote to his wife in January 1780,