However, in 1497, with the death of Toshikuni SAITO, the Mino no kuni Shugodai (deputy military governor of Mino domain) who had provided reinforcements, he was pursued once again by Masatsune and took temporary refuge at Umezu (Mino Province).
しかし、1497年（明応5年）に助力を得ていた美濃国守護代斎藤利国が亡くなると、再び政経に追われ、美濃海津に寄留する。