Battey returned to the minor leagues in 1956, playing in 36 games for the Toronto Maple Leafs. Despite hitting only .178, he played well defensively. The White Sox called him back to the major leagues to back up starting catcher Sherm Lollar, for the remainder of the season although, he spent the time on the bench and played in only four games. Battey continued to learn from the perennial All-Star Lollar during the 1957 season but struggled offensively. He was sent back to the minor leagues in August where he hit 9 home runs and 20 runs batted in for the Triple-A Los Angeles Angels of the Pacific Coast League. The White Sox recalled Battey to the major leagues in September – this time to stay.