Loggia was married to Marjorie Sloan from 1954 until they divorced in 1981. He was married to Audrey O'Brien from 1982 until his death in 2015. Loggia has two children of his own and a stepchild. Loggia died at his home in Los Angeles, California from Alzheimer's disease, aged 85.