While his elder brother MINAMOTO no Tsunekuni (Genta KAWACHI Tsunekuni) went down to Kanto, MINAMOTO no Yoshitaka lived in Kyoto was promoted steadily in government service as the Taira family increased its power.
兄に源経国（河内源太経国）がいるが、経国が関東に下ったのに対し、源義高は都に住し、平家が勢力を強めるに従って順調な官途を進んだ。