The castle, however, was taken by Ieharu RYUZOJI as a result of the Battle of Kyushu waged by Hideyoshi TOYOTOMI, and in early-modern times, it became a residential castle of the Isahaya family, the offspring of Ieharu RYUZOJI.
だが、豊臣秀吉の九州の役に伴い龍造寺家晴に奪われ、近世においては子孫の諫早家の居城となった。