However, in 1550, due to the revolt of his senior vassal Sadayori OUCHI against him, Naoyoshi was held captive within the castle and lost his authority.
しかし、天文(元号)19年（1550年）尚義は重臣の大内定頼に下克上され、城内に監禁され実権を奪われた。