He was the fifth son of MINAMOTO no Yoshitomo and his mother was Yura-gozen, a daughter of FUJIWARA no Suenori who was a Daiguji (the supreme priest) of Atsuta-jingu shrine.
源義朝の五男で、母は熱田神宮大宮司藤原季範娘の由良御前。