He was born as the child of Moriemon MOTOI, a myoshu (owner of rice fields), however he didn't get along with his older brother, Taizo, and he left home in May 1858 to settle in the house of his uncle, Eikichi, in Ueno Isesaki.
名主元井森右衛門の子として生まれたが、兄・鯛蔵と仲が悪く、安政5年（1858年）5月に家出して、上野伊勢崎の伯父・栄吉のもとに住み着く。