In 1901, Aldrich's son Charles, who had gotten married the year before, was found to have a disease called tuberculosis. Aldrich built two houses, one for his son and one for him and his family, in Saranac Lake, New York, which was the leading treatment centre for the disease at the time. On March 6, 1904, Charles Aldrich died of tuberculosis, at the age of thirty-four. The family left Saranac Lake and never went back.