His younger brothers by different mothers included MINAMOTO no Yorichika of the Yamato-Genji (Uno, Nara Prefecture), and MINAMOTO no Yorinobu of the Kawachi-Genji (Habikino City, Osaka Prefecture), who later became the main line of the Buke (Warrior) Genji (MINAMOTO clan).
異母弟に大和源氏（奈良県宇野）の源頼親、後に武家源氏の主流となる河内源氏（大阪府羽曳野市）の源頼信がいる。