Mazursky was born in Brooklyn, New York City. His family were Jewish and his grandfather was a Ukrainian immigrant. He was married to Betsy (Purdy) Mazursky from 1953 until his death. They had two children. He was an atheist.