Ohm began to play football in the youth department of BSG Lokomotive Haldensleben, north of Magdeburg. In 1962 he joined the focus club of BSG Lokomotive, SC Lokomotive Leipzig, after playing four matches for the youth national team in the spring.