Then, he moved to 入道水村 in Higo Province (the present Kikuyocho in Kumamoto province) to depend on his uncle, Tadaharu NAGAOKA who was a member of the Hosokawa-naizen family; After a while he settled there, he suffered from illness, which killed him at the age of 45 in 1670.
そして、叔父にあたる細川内膳家長岡忠春を頼って肥後国入道水村（現在の熊本県菊陽町）に下向、そこで暮らしていたが病を得て寛文10年に45歳で卒去した。