However, on May 1, 1723, he was transferred to the Sakura Domain in Shimousa Province, and was replaced with Masatomo INABA who took over with 102,000 koku and began a long-term presence for the INABA family.
しかし享保8年（1723年）5月1日には下総国佐倉藩へ移され、入れ替わりで稲葉正知が10万2000石で入ることで、ようやく藩主家が定着した。