He is the second son of MINAMOTO no Yorimori who was Soryo (heir) of the Tada-Genji (Minamoto clan), and he had an older brother called Yukitsuna TADA (Tada kurodo no daibu [Master of Chamberlain]) and younger brothers, Takayori NOSE (Kokamonin Kurodo [the Chamberlain of Kokamonin]) and Takazane (Takamatsuin Kurodo [the Chamberlain of Takamatsuin]).
多田源氏の惣領であった源頼盛の次男で、兄に多田行綱(多田蔵人大夫)、弟に能瀬高頼(皇嘉門院蔵人)、高実(高松院蔵人)があった。