In 1859, his father Hanzaemon was cast out from the domain, and he grew up in Kunitomo-mura Village, Omi Province (present Nagahama City Shiga Prefecture), where his relatives were living.
1859年、半右衛門が藩より追放され、親類のいる近江国友村(現滋賀県長浜市)で育った。