He married the Lady Elizabeth FitzMaurice, daughter of William FitzMaurice of Gallane and niece of Thomas FitzMaurice, 1st Earl of Kerry. She was thus the cousin of Lady Arabella Denny. The Horts second son, John, married a woman who belonged to a branch of the Butler family and was appointed consul-General at Lisbon in 1767. That same year he was made a baronet. Sir John Hort was the grandfather of the English theologian Fenton John Anthony Hort and great grandfather of Richard Garnons Williams, soldier and international rugby player.