 Scherger enlisted in the United States Army during World War II, which placed him in charge of the gymnasium at Fort Bragg.Scherger returned to play in 1946 for the Class B Danville Dodgers of the Illinois–Indiana–Iowa League.Through four years of competition, he held a .258 batting average with 285 hits, 42 doubles, 17 triples, and 5 home runs.