Subsequently, a newcomer Shinzaemon NAGAI (the father of Dosan SAITO), who gained power, dismissed Yoritake from the position of Shugo, and assigned Yorinari, who lived in Sagiyama-jo castle, to the position.
やがて新参の長井新左衛門尉（斎藤道三の父）が頭角を現すと、守護の頼武を追放して鷺山城の頼芸を守護に就ける。