Gradually Gerhoh adopted a stricter ecclesiastical attitude, and eventually withdrew (1121) from the simoniacal Bishop Hermann, and took refuge in the monastery of Raitenbuch in the Diocese of Freising. After the Concordat of Worms (1122) Bishop Hermann was reconciled with the legitimate pope, Callistus II, whereupon Gerhoh accompanied the bishop to the Lateran Council of 1123.
He studied at Freising, Moosburg, and Hildesheim. In 1119, Bishop Hermann of Augsburg called him as "scholasticus" to the cathedral school of that city; shortly afterwards, though still a deacon, he made him a canon of the cathedral.