He began playing baseball in local American Legion leagues, where he learned the basics of catching while playing both outfield and infield positions. He also played for a Cranston, Rhode Island, team under an assumed name. While playing in American Legion baseball, he received the nickname "Yogi" from his friend Jack Maguire, who, after seeing a newsreel about India, said that he resembled a yogi from India whenever he sat around with arms and legs crossed waiting to bat or while looking sad after a losing game.