He was married to a daughter of FUJIWARA no Nobutaka, who was Yamashiro no kami (the governer of Yamashiro Province) and the husband of Murasaki Shikibu (the author of the Tale of Genji) (although it is not known whether she was her mother), and had a child, Jotomonin no chujo, who was selected as one of Chuko sanjurokkasen (36 great waka poets, who had been not been chosen as 36 Great Poets by Fujiwara no kinto, or those of later times).
妻は紫式部の夫山城守藤原宣孝の娘（紫式部の娘か否かは不明）で中古三十六歌仙のひとり上東門院中将をもうける（中古歌仙伝）。