Jochum was born in Babenhausen, near Augsburg, in the south of Germany. He soon showed musical talent and was playing the organ for church services when he was eight. He studied at the Augsburg Conservatory and then the Munich National Theatre and at Mönchen-Gladbach. He became conductor of the Kiel Opera where, during three years, he conducted more than 50 operas in several German cities. Then, in 1934, he followed Karl Böhm and Karl Muck as the conductor of the Hamburg Staatsoper. He stayed there until 1949. He also was guest conductor in Amsterdam with the Concertgebouw Orchestra and later he became chief conductor. 