He also secretly slept with FUJIWARA no Genshi, who had the title of Jokyoden Nyogo, who had seemingly been faithful to her husband, Emperor Ichijo, after his death; FUJIWARA no Akimitsu, who was the father of Genshi and had the title of Udaijin (Minister of the Right), became angry and cut off her hair with his own hands and disowned her, but Genshi eloped to Yorisada within the darkness of the night and gave birth to two daughters with him.
また、一条天皇没後、孤閨を託った承香殿女御藤原元子と密かに情を交わし、激怒した元子の父右大臣藤原顕光が手ずから娘の髪を切り勘当したけれども、元子は夜蔭にまぎれて頼定のもとに走り、遂に二女を儲けた。