Later, it was inherited from Ashikaga Shogun Family to Hideyoshi TOYOTOMI, Ieyasu TOKUNAGA, Hidetada TOKUGAWA, Tadanao MATSUDAIRA (husband of a daughter of Hidetada), and then from Takada Domain of Matsudaira Family in Echizen Province to Tsuyama Domain.
後に足利将軍家から豊臣秀吉、徳川家康、徳川秀忠、松平忠直（秀忠娘婿）に継承され、越前松平家の高田藩から津山藩に継承された。