From 1972 to 1977, while a student at FSU's School of Music, Goldstein performed as "The Marv Allen Combo" in Tallahassee's lounge and cocktail circuit. He performed with local jazz drummer Paul Rosete, bassist Carl Cerniglia, percussionist George Rosete, and saxophonists Jodie Coogle and Michael Wallace. As a sought out lounge act, the Combo’s performances were frequently augmented by local singers, such as Sarah Copeland, Carol Smith, and soprano Linda Zoghby. Goldstein was part owner of a local music store called Music World.