His family line was the Hosokawa clan, a branch family of the Ashikaga clan founded by MINAMOTO no Yoshikuni who had been a son of MINAMOTO no Yoshiie, a Chinju-fu shogun (Commander-in-Chief of the Defense of the North) and the head of the Kawachi-Genji that was derived from a family line of Seiwa-Genji (Minamoto clan).
家系は清和源氏の一家系河内源氏の棟梁　鎮守府将軍源義家の子　源義国を祖とする足利氏の支流　細川氏。