As the castle was occupied again later in a family feud, he began the construction of a new castle in Takaoka, located between the Iwaki-gawa and Tsuchibuchi-gawa rivers in 1603 (Takaoka later became Hirosaki City, and the castle is called Hirosaki-jo).
その後も家中騒動にて城が占拠されたりなどしたため、慶長8年（1603年）には岩木川と土淵川に挟まれた高岡（鷹岡）に新城を着工した（のちに弘前市と改名、城は弘前城と呼ばれる）。