Yasutoki's mother was Anan no Tsubone, who was the wife of his father and whose origin was unknown because she was only recorded as a woman who worked in the Imperial Palace.
母は側室の阿波局で、御所の女房と記されるのみで出自は不明。