On November 13, 2008, Swisher and minor league pitcher Kanekoa Texeira were traded to the New York Yankees for utility man Wilson Betemit and minor league pitchers Jeffrey Marquez and Jhonny Núñez. Swisher was acquired to be the Yankees starting first baseman. However, the Yankees signed Mark Teixeira later in the offseason, who took the starting role. At the end of spring training, manager Joe Girardi announced that Xavier Nady would be starting in right field while Swisher would be a bench player. Due to the perceived logjam, many teams reportedly pursued Swisher, but the Yankees opted to keep him as a reserve outfielder and first baseman.