Yoriharu's downfall following those of his great-grandfather, MINAMOTO no Yorichika and his grandfather, MINAMOTO no Yorifusa ended up giving further impetus to power decline of Yamato-Genji.
曽祖父源頼親、祖父源頼房に次ぐ頼治の失脚は、大和源氏の勢力衰退に一層拍車をかけることとなった。