Zimmer was born in Cincinnati, Ohio. He was married to Soot (Jean) from 1951 until Zimmer's death. The couple had two children, Thomas and Donna. In December 2008, he suffered a stroke which caused a loss of speech for a week.