Kalter was born on March 21, 1943 in New York City, New York. He was raised in Brooklyn, New York. Kalter studied at Hobart College. He was married to Carol Cepler until they divorced. He married Peggy Masterson in 2003. Kalter lives in Stamford, Connecticut. 