His daughters-in-law are Empress Akikonomu (a child of Lady Rokujo) and Tamakazura (The Tale of Genji) (a child between Naidaijin and Yugao), and he has an ostensible child, Kaoru (a child between Kashiwagi and Onna Sannomiya).
ほか養女に秋好中宮（六条御息所の子）と玉鬘(源氏物語)（内大臣と夕顔の子）、表向き子とされる薫（柏木と女三宮の子）がいる。