Goldsmith was born in September 26, 1938 in New York City, New York to a Jewish family. He studied at Boston University. He was married to Barbara Goldsmith since 2006. He now lives in Marina del Rey, California and in Manchester, Vermont.