However, during the construction to improve its defensive capabilities it was attacked by Hisahide MATSUNAGA and the Miyoshi Sanninshu in 1565 and Nijo-jo Castle burned down; even though Yoshiteru himself took up his sword and fought he was killed (Eiroku Disturbance).
しかし、防御能力強化工事中の永禄8年（1565年）、松永久秀と三好三人衆に襲撃され、自ら刀を執って奮戦するも義輝は殺害され二条城は焼失した（永禄の変）。