In March, 1183, he joined forces with MINAMOTO no Yoshihiro (SHIDA Saburo Senjo) of Hitachi Province to fight against Tomomasa OYAMA of Yoritomo's army at Nogimiya, but was defeated miserably and fled to Kozuke (the Battle at Nogimiya).
寿永2年（1183年）2月、常陸国の源義広(志田三郎先生)と結び、頼朝方についた小山朝政と野木宮で戦うが、あえなく敗北し上野へ逃げ戻った（野木宮合戦）。