In the Heiji War of 1159, he also fought under Yoshitomo, following Akugenta (by-name) MINAMOTO no Yoshihira, Yoshitomo's eldest son; however, the Yoshitomo's side was defeated, and he fled to Oshu, asking Hidehira, his aunt's husband, for help.
平治元年（1159年）の平治の乱でも義朝に属し、義朝の長男である悪源太源義平に従い戦うが、義朝方は敗れ、伯母の夫である秀衡を頼って奥州へと落ち延びる。