Swift is pictured in one of the most famous photographs in American sporting history. He was the catcher for the Detroit Tigers on August 19, 1951, when St. Louis Browns owner Bill Veeck sent midget Eddie Gaedel to pinch hit during an actual MLB game. The stunt was inspired by the James Thurber short story "You Could Look It Up" and Gaedel was allowed to bat when the Browns showed the umpires a legitimate baseball contract. Swift knelt on the ground to receive pitcher Bob Cain's offerings—it is this kneeling stance that is captured in the photo—and Gaedel took a base on balls. He was immediately replaced at first base by a pinch runner and he never appeared in a big league game again.