Williams was born in Wall Lake, Iowa. Some sources say he was born in 1927, others say 1928. Williams was married to Claudine Longet from 1961 until they divorced in 1975. He was later married to Debbie Meyer from 1991 until his death in 2012. Williams had 3 children. In November 2011, Williams was diagnosed with bladder cancer. Williams died on September 25, 2012 in Branson, Missouri from the cancer, aged 84.