Ismay was born on December 12, 1862 in Crosby, Lancashire, England. He was married to Julia Florence Schieffelin from 1888 until his death in 1937. They had five children. Ismay died on October 17, 1937 in Mayfar, London, England from a stroke, aged 74.