During the Hogen War, he sided with the Emperor Goshirakawa whom Yoshitomo served, but took some actions to avoid the Minamoto clan infighting such as asking MINAMOTO no Tameyoshi (brother-in-law) to restrain himself but without success.
保元の乱の際も、自身は源義朝が属した後白河天皇の陣営に身を置きながら、源氏相克の事態を防ぐべく、源為義（義兄）に自重を求めるなど活動したが、果たせなかった。