Ironically, when Hideie died of an illness in 1603 and then followed by his father in the next year, Yoshimasa moved to Kishiwada, which was his late father's property inheritance, and Izushi was governed by his son, Yoshifusa KOIDE.
皮肉な事に慶長8年（1603年）に秀家が父に先立って病死し、翌年に秀政が死去すると、吉政は父の遺領である岸和田に移り、出石は息子の小出吉英が領することとなった。