Barry was born on June 14, 1919 in New York City, New York to a Jewish-Russian family. He studied at Chatham Square School of Music. Barry was married to Betty Claire Kalb from 1944 until her death in 2003. They had three children, one adopted. 