In between, Zimmer saw action in all or parts of 18 minor league seasons spanning 1949–1967. He also played winter baseball with the Elefantes de Cienfuegos and the Tigres de Marianao of the Cuban League during the 1952–53 season, as well as for the 1954–55 Puerto Rican League champion Cangrejeros de Santurce en route to the 1955 Caribbean Series. Zimmer led his team to the Series title, topping all hitters with a .400 batting average (8-for-20), three home runs and a .950 slugging percentage, while claiming Most Valuable Player honors.