King married Harriet Lethbridge in 1817. The couple had eight children. Two of his sons, Philip Gidley (named after his grandfather) and John, were both pastoralists and politicians. King died in North Sydney on 26 February 1856 at the age of 64.