Baisao's father, Mokunoshin SHIBAYAMA, worked for the Nabejima clan of Hasuike domain as the lord's physician, while he was the third son born to his mother Miya.
蓮池藩・鍋島氏に仕える御殿医であった父、柴山杢之進と、母、みやの三男として生まれる。