Nobusuke SHIBAYAMA (a samurai who worked for the Owari Domain), Fusatoyo ABE (a samurai who worked for the Yunagaya Domain) and Zuijun CHOTOKUIN (a court physician and a hatamoto (a direct vassal of the shogun) were his younger brothers.
弟に、芝山宣助（武士・仕尾張藩）、阿部房豊（武士・仕湯長谷藩）、長徳院瑞屯（侍医・旗本）などがいる。