He was born as the second son of ABE no Yoritoki, the leader of the Abe clan, which was a local ruling family of fushu (Ezo people from Northeastern provinces who subjugated themselves to the Imperial Court) in Okuroku County.
安倍氏(奥州)の棟梁・奥六郡の俘囚の豪族安倍頼時の第2子。