His brothers were MINAMOTO no Yorimitsu, MINAMOTO no Yorinobu, MINAMOTO no Yorihira, MINAMOTO no Yorinori, MINAMOTO no Takamichi, and Genken, and Yorinobu was his maternal half brother.
兄弟に源頼光、源頼信、源頼平、源頼範、源孝道、源賢などがあり、頼信とは同母兄弟にあたる。