Ieyasu TOKUGAWA, who gained the control of the whole country after Hideyoshi's death, valued this castle as he transferred Nagamori OKABE, who was a Fudai Daimyo (hereditary vassals of the Tokugawa or allies in the Battle of Sekigahara), to this castle as the lord (1609 - 1621) of Tanba-Kameyama Domain in 1609.
秀吉の死後に天下を手中にした徳川家康もこの城を重要視し、慶長14年（1609年）に譜代大名である岡部長盛（在任1609～21）を入封させ、丹波亀山藩主に任じた。