His brothers were MINAMOTO no Yoshichika, a strong general known as 'Aku Tsushima no kami' (The Bad Governor of Tsushima Province), and MINAMOTO no Yoshikuni, a strong general known as 'Ara Kaga nyudo' (Rowdy Lay-monk of Kaga).
兄弟に「悪対馬守」といわれた猛将の源義親、「荒加賀入道」といわれた猛将の同母兄弟源義国らがいる。