The reason that Yorimori was chosen might be because his wife was nyobo in the service of Hachijoin, and he was therefore judged to be the best choice to negotiate with Hachijoin.
頼盛が選ばれたのは妻が八条院の女房で、八条院との交渉には最適と判断されたためと思われる。