After returning from Korea, he married Yae Kimura (1904–1978) who died at age 74, and changed his name to Jiroemon Kimura, since his wife's family lacked a male heir, and had seven children, five of whom are still living. He lived in Kyōtango, Kyoto Prefecture, Japan with his eldest son's widow and grandson's widow.