His brothers included MINAMOTO no Yorisuke, MINAMOTO no Yorizane, MINAMOTO no Sanekuni, MINAMOTO no Kunifusa, MINAMOTO no Moromitsu, and Rokujosaiin no senji, and Moromitsu was his maternal half brother.
兄弟に源頼資、源頼実、源実国、源国房、源師光、六条斎院宣旨などがあり、師光は同母弟。