Warner was married to Catherine Mellon in 1957 until they divorced in 1973, they had three children. Then he was married to Elizabeth Taylor from 1976 until they divorced in 1982. In 2003, he married Jeanne Vander Myde.