Oerter was born in 1936 in Astoria, Queens, New York City and grew up in New Hyde Park; he attended Sewanhaka High School in Floral Park. He began his track and field career at the age of 15 when a discus landed at his feet and he threw it back past the crowd of throwers. Oerter continued throwing and eventually earned a scholarship to the University of Kansas in 1954 where he became a member of Delta Tau Delta fraternity. A large man at 6' 4" (193 cm) and 280 pounds (127 kg), Oerter was a natural thrower. Competing for Kansas, he became the NCAA discus champion in 1957; he successfully defended his title the following year.