Herrmann had a contract dispute with the White Sox during spring training in , and after ten years with the White Sox organisation, he was traded to the New York Yankees on April 1 of that year. He served as a third-string catcher for the Yankees during the 1975 season, working behind Thurman Munson and ahead of Rick Dempsey, before he was purchased in February 1976 by the California Angels. Herrmann played only a half season with the Angels during which he platooned alongside right hand hitting catcher Andy Etchebarren. In June 1976, Herrmann was traded to the Houston Astros, where he replaced Milt May as the Astros' starting catcher. Herrmann was the Astros catcher on July 9, when pitcher Larry Dierker threw a no-hitter against the Montreal Expos. He worked as back up catcher to Joe Ferguson in 1977, posting a .291 batting average in 56 games. Herrmann was purchased by the Montreal Expos in 1978 where he was a reserve catcher, working behind Gary Carter. He retired at the end of the season.