He was from the Inoue clan, a vassal of Mori clan which was local lords in Aki Province following Kawachi-Genji (Minamoto clan), one family lineage of Seiwa-Genji (Minamoto clan originated from Emperor Seiwa).
清和源氏の一家系河内源氏の流れを汲む安芸国人毛利氏家臣・井上氏。