However, in August, 1617, he was transferred to Takasaki Castle with fifty thousand Goku, and two years later, in October 1619, he was transferred to Shinoyama Castle and became Izu no kami (Governor of Izu Province).
だが、元和3年8月（1617年）に5万石をもって高崎城に転封され、続いて翌々年の元和5年（1619年）10月には更に篠山城に移されて伊豆守に転じる。