His father was a hatamoto (a direct retainer of the shogun) called Masayoshichubei TOYAMA, who was a trainer of foot soldiers at a kobusho (military training school) of the Edo bakufu (Japanese feudal government headed by a shogun).
父は旗本で江戸幕府講武所歩兵指南役の外山忠兵衛正義。