During his early years in Cleveland, Goldman served as the director of the Akron Opera Company and the Cleveland Jewish Singing Society. He directed the Opera Department at the Cleveland Institute of Music, served as the choral director at Euclid Avenue Temple, and the Vocal Director at the Cleveland Music School Settlement. Goldman also served as the cantor at Fairmont Temple and Temple On The Heights. Additionally, he hosted two highly popular Cleveland radio programs, "Operama" (WHK radio) and "Classics In Wax."