Tokifusa HOJO, a son of Tokimasa who had a strong relationship with Yoshinari, was Yoriie's partner in playing kemari (a game played by aristocrats in the Heian period), which shows that Yoriie was watched by the Hojo clan (see also the section of "the contortion and award of Azuma Kagami").
この能成と深い関係のあった時政の子・北条時房も頼家の蹴鞠の相手となっており、頼家の周辺には北条氏による監視の目があったと見られる（『吾妻鏡吾妻鏡の曲筆と顕彰』も参照の事）。