Ramis was born in Chicago, Illinois to a Jewish family. He was married to San Francisco artist Anne Plotkin from 1967 until their divorce. They had a daughter, Violet, whose godfather is actor Bill Murray. He later married Erica Mann in 1989. They had two sons: Julian Arthur and Daniel Hayes.