He was a grandchild of MINAMOTO no Sanekuni, and his father 行延, who was a monk of Onjo-ji Temple, was adopted by Sanekuni's younger brother MINAMOTO no Yoritsuna (TADA no Akikuni).
源実国の孫にあたるが、園城寺の僧であった父行延は実国の弟源頼綱（多田頼綱）の養子となっている。