After retiring in 1937 with a 210–158 win-loss record, Haines was a coach with the Brooklyn Dodgers in 1938. He left baseball after that season and returned to his native Ohio. He was elected to the Baseball Hall of Fame in 1970. However, his election was not without controversy, as the Veterans Committee included former teammates of Haines, resulting in charges of cronyism against the Veterans Committee. In 2014, he was inducted into the St. Louis Cardinals Hall of Fame Museum. He ranks second in franchise history in shutouts.