At last, on June 5, 1666, the bakufu issued the order of kaieki (punishment by being deprived of one's fief) to Takakuni because of the discord between parent and child as well as his misrule of the domain, and Takakuni was placed in custody of Shigenobu NANBU, the lord of the domain of Morioka of the Province of Mutsu.
このため寛文6年（1666年）5月3日、親子不和や悪政を理由に幕命によって改易され、陸奥国盛岡藩主・南部重信預かりの身となった。