However, when the relation between Yoshinaka and Goshirakawa-in (Retired Emperor Goshirakawa) soon got worse, he took the side of In and, in December of the same year, he played a central role in defending In no gosho (the retired Emperor's court) with his son.
しかし間もなく義仲と後白河院の関係が悪化すると院方に付き、同年11月の法住寺合戦では子息と共にその主力として院御所の防衛に当たった。