The castle is said to have been built by Hidetsuna (栄綱) TSUCHIMOCHI at the end of the 12th century or Kunitsuna (国綱) TSUCHIMOCHI at the end of the 13th century ("Enryo Kyuki" (Ancient Record of Nobeoka domain), "Enryo Seikan" (History of Nobeoka domain)).
築城者は、12世紀末の土持栄綱または13世紀末の土持国綱と言われる（『延陵旧記』『延陵世鑑』）。