Southworth was elected to the Baseball Hall of Fame in 2008. He had been eligible for election as a player in the 1940s, but he received few votes. After Southworth had been left off of the ballot as a manager in 2003, author Raymond Mileur had begun a campaign of letter writing, phone calls to the Hall of Fame, radio show comments and advocacy through his website known as "The Birdhouse". Southworth was elected after receiving 13 votes from the 16-member Veterans Committee.