Having further lost confidence and popularity, Yoshinaka tried to shut up Cloistered Emperor Goshirakawa and take power coercibly, but in February 1184, he was annihilated by the troop of MINAMOTO no Noriyori and MINAMOTO no Yoshitsune dispatched by Yoritomo in Kamakura.
いよいよ信望を失った義仲は後白河法皇を幽閉して強引に政権を握ろうとするが、寿永3年（1184年）正月、鎌倉の頼朝が派遣した源範頼・源義経の軍に滅ぼされた。