His family line was the Hosokawa clan which was a branch family of the Ashikaga clan with its founder, MINAMOTO no Yoshikuni, a son of MINAMOTO no Yoshiie, the Chinju-fu shogun (Commander-in-Chief of the Defense of the North) who was the head of the Kawachi-Genji (Minamoto clan), a family line of the Seiwa-Genji (Minamoto clan).
家系は清和源氏の一家系　河内源氏の棟梁　鎮守府将軍源義家の子　源義国を祖とする足利氏の庶流　細川氏。