He was sponsored through the New York Athletic Club. Baumgartner attended Manchester Regional High School in Haledon, New Jersey.
During high school, Baumgartner excelled on the wrestling team, going 23–0, but was defeated in the NJ State Championship match. During the off-season he threw shot put and discus on the track team, setting several records in the shot put.