However, he was attacked by Genbanojo MATSUMIYA, hikan (low-level bureaucrat) of the Takeda clan in 1569, and the Numata family escaped to Omi; as a result, Komogai-jo Castle became a subsidiary castle of the Matsumiya clan.
しかし、永禄12年((1569年))、武田氏の被官・松宮玄蕃允に攻められ沼田一族は近江へ退出し、熊川城は松宮氏の支城となった。