Hillary married Louise Mary Rose in 1953, by whom he had a son and two daughters. In 1975, his wife and their younger daughter were killed in a plane crash. Hillary married June Mulgrew in 1989; they remained married until he died.