One theory says that he was adopted by his older brother MINAMOTO no Yoritsuna (according to "Sonpi Bunmyaku" [a text compiled in the fourteenth century that records the lineages of the aristocracy]).
一説には、五兄頼綱の養子となっていたともされる（『尊卑分脈』）。