Subsequently, it is said that the castle was inherited by the descendents of Yoshizumi ASHIKAGA who inherited the family name of HATAKEYAMA, but the details until the later years of the 15th century are unknown.
のちは畠山の名跡を継いだ足利義純の子孫に伝えられたというが、15世紀後半に至るまでの詳細は不明である。