As his mother died in May (1670) shortly after giving birth to Yasubei, he was left to his maternal grandmother Akika MIZOGUCHI for a while and brought up until the age of three by Akika as her own son.
母は、安兵衛を出産した直後の寛文10年（1670年）5月に死去したため、しばらくは母方の祖母・溝口秋香のところへ送られて、秋香を母代わりにして三歳まで育てられた。