When Tadateru possessed Echigo (currently Niigata Prefecture), he was the lord of Fukushima-jo Castle (Echigo Province) which the Hori clan built, but he constructed Takada-jo Castle in 1614 and moved into it.
越後領有当初の忠輝は、堀氏が築いた福島城(越後国)の城主であったが、慶長19年（1614年）に高田城を築城し、これに移った。