Also in the same year, he was defeated by the Imagawa clan at the second battle of Azukizaka and he lost Ansho-jo Castle in the third battle of Ansho-jo Castle, which subsequently happened, then he gradually became surrounded by Imagawa, Saito and other domestic enemies.
また同年、小豆坂の戦い第二次合戦で今川氏に敗れ、続いて発生した安城合戦第三次安城合戦で安祥城を失うなど、次第に今川・斎藤・そして国内の敵などに包囲されて苦しめられるようになった。