But Takaharu was punished by being deprived of his rank or fief due to the suspicion of secret communication with Toyotomi clan in the Summer Siege of Osaka in 1615, and Nobukatsu reentered Yamato Province and Kozuke Province.
1615年の大坂夏の陣で豊臣氏に内通した嫌疑をかけられて改易され、信雄が再び入封する。