While Voigts's tenure at Northwestern started successfully, he came under increasing pressure in the early 1950s after posting a string of losing records. He resigned in February 1955, citing his failure to put together winning teams. "It was just an increasing amount of criticism over my coaching, and it was probably hurting the school so I just quit", he said at the time. He said he had "no future plans" and had not considered whether he would return to pro football. He is sixth among Northwestern coaches in total wins and 12th in winning percentage. Lou Saban, a former Browns lineman who had served as assistant to Voigts, replaced him as head coach.