He was a child of MINAMOTO no Yoshinari, the eldest son of MINAMOTO no Yoshimitsu who was the third son of MINAMOTO no Yoriyoshi, Chinju-fu shogun (Commander-in-Chief of the Defense of the North).
鎮守府将軍源頼義の三男源義光の長男・源義業の子。