His mother was either a daughter of Udaijin (Minister of the Right) MINAMOTO no Morofusa or a daughter of FUJIWARA no Tadatoshi, who was FUJIWARA no Takaie's grandson; Gyogen was his half-brother by the same mother.
母は右大臣源師房の娘或いは藤原隆家の孫藤原忠俊の娘で同母兄に行玄がある。