Among his real children were Sadatoyo SHIBAYAMA, Nobusuke SHIBAYAMA (samurai of Owari clan), Fusatoyo ABE (samurai of Yunagaya clan), Zuijun CHOTOKUIN (court physician, direct retainers of the bakufu, which is a form of Japanese feudal government headed by a shogun), and so on.
実子に芝山定豊、芝山宣助（武士・仕尾張藩）、阿部房豊（武士・仕湯長谷藩）、長徳院瑞屯（侍医・旗本）などがいる。