1155: When his father Yoshikata was attacked and killed in battle by his nephew, MINAMOTO no Yoshihira, he was given the patronage and adopted by MINAMOTO no Yorimasa of Settsu Genji (Minamoto Clan in Settsu Province) and was raised in Kyo (Kyoto).
久寿2年（1155年）、父義賢が甥の源義平に襲撃され戦死すると、摂津源氏の源頼政に保護され、その養子となって京で成長する。