His grandfathers were MINAMOTO no Yoshiie, Chinju-fu shogun (Commander-in-Chief of the Defense of the North) and the third generation of Kawachi-Genji (the Minamoto clan), and TAIRA no Masamori of Ise-Heishi (the Taira clan), Tajima no kami (governor of Tajima Province), in which these fact indicates that he was descended from the Minamoto and the Taira clans.
祖父は河内源氏第三代、鎮守府将軍源義家と、伊勢平氏の但馬守平正盛）という源平両氏の血を引く。