However, in 1July 541 when Nobuzane Takeda was the ninth head of Aki-Takeda clan, Kanayama-jo Castle was ruined by Motonari MORI who was ordered to attack by the Ouchi clan, and the clan extinguished.
しかし、安芸武田氏9代武田信実の時代、1541年（天文_(元号)10年）6月に大内氏の命を受けた毛利元就によって銀山城は落城し滅亡した。