Following an order from Ieyasu TOKUGAWA he participated in the battle for Shingu-jo Castle and after it had surrendered he stationed troops to ensure the ownership rights were secured however, ultimately the Kii Province was given to Yoshinaga ASANO whereupon SUGIWAKA was punished by being deprived of his fief.
続いて徳川家康からの命により新宮城の攻撃に参加し、同城落城後も暫く駐屯し本領安堵を待つが、結局紀伊国は浅野幸長に与えられることになり、杉若氏は改易となった。