Karl was married to Faye Brooker Karl from 1948 until their divorce in June of 1971. They had four children. He married Mercedes Jensen Proctor in August of 1971. Karl had suffered heart disease, Parkinson's disease, and diabetes. Karl died on March 7, 2013 from heart disease in his home in Tampa, Florida, aged 88.