Hershey was married to Catherine Sweeney from 1898 until her death in 1915. In 1912 Hershey was supposed to go on the RMS "Titanic", but business concerns forced him to take an earlier ship from Europe to the United States. Sweeney died three years later.