In the same year, his father was accused of his misconduct during the time he served as roju; as the punishment for this, 20,000 koku was diminished and the territory was moved to Yamagata, Dewa Province.
同年父が老中在職中の不正を咎められ、2万石減封の上出羽山形に転封となる。