Loxton married three times. He divorced his first wife Hilda in February 1952 after a nine-year union that produced no children. The cricketer then wed Caryl Bond, whom he had met during the 1949–50 tour of South Africa, and the pair had two sons. Loxton later divorced Bond and wed his third wife Joan Shiels. In 2000, one of his sons and his third wife died on the same day, due to a shark attack in Fiji and drowning in the family swimming pool, respectively. In later life he lived alone and was still mobile despite being almost blind. Loxton died on 3December 2011.