When Yoritomo entered Musashi Province raising an army again with his renewed power on October 31, 1180, Shigeyori surrendered to him with Shigetada HATAKEYAMA and Shigenaga EDO.
しかし10月4日(旧暦)、勢力を回復して再挙した頼朝が武蔵国に入ると、畠山重忠・江戸重長らと共に傘下に入る。