From 2005 on he was coach of the VfL Bochum in the 2.Bundesliga. They promoted to the Bundesliga. The next year was planned to stay in the league. The club finished this year in 8th place, the third-best season for Bochum ever. After poor results at the beginning of the 2009/10 season, Koller was dismissed.