In September 1158, Yorimori was appointed to the post of Hitachi no suke for the second time and, in October, he became Mikawa no kuni no kami (Governor of Mikawa Province) by exchanging chigyo koku with FUJIWARA no Akinaga.
翌保元3年（1158年）8月には二回目の常陸介となり、10月には藤原顕長と知行国を交換して三河国となった。