Yasutoki continuously met with misfortunes after that, as three years later, on August 5, 1230, his first son Tokiuji HOJO died of a disease at the age of 28 and, one month later his 25-year-old daughter, who had married Yasumura MIURA, gave birth; the child died about ten days later and the daughter, whose own post-delivery recovery was slow, died on September 19 at the age of 25.
3年後の寛喜2年（1230年）6月18日には長男の北条時氏が病のため28歳で死去し、その1ヶ月後の7月に三浦泰村に嫁いだ娘が出産するも子は10日余りで亡くなり、娘自身も産後の肥立ちが悪く8月4日に25歳で死去するなど、立て続けに不幸に見舞われた。