When his father Hachimantaro Yoshiie died, his right older brother (the fifth son or the forth son of his father) MINAMOTO no Yoshitada succeeded to the family head and became the toryo (leader) of the Minamoto clan.
父の八幡太郎義家が死去するとすぐ上の兄、源義忠が家督を相続し源氏の棟梁となる。