However, there were those who were displeased with Yoshitada for forming alliances with the newly-risen Ise-Heishi, such as many members of Kawachi-Genji as well as other Minamoto clans who were also resentful that Yoshitada was working with the government ruled by the retired Emperor and expanding his own power by aligning with the Ise-Heishi.
しかし、河内源氏の中では新興の伊勢平氏との対等の関係を結んだ義忠のやり方に不満も多く、また、伊勢平氏と和合することで院政に接近した義忠が勢力を伸ばしたことを快く思わない源氏の一族の勢力も存在した。