The Yoda Family, descended from the Takeda clan of Kai Province, was a wealthy farmer's family in Osawa-mura Village, Naka-gun County, Izu Province (present-day Matsuzaki-cho, Kamo-gun County, Shizuoka Prefecture), and Benzo was born as the third-born son of Zenemon.
依田家は甲斐国武田氏の流れを汲む伊豆国那賀郡大沢村（現：賀茂郡(静岡県）松崎町）の豪農で、勉三は善右衛門の三男として生まれた。