He was a descendent of Seiwa-Genji (Minamoto clan originated from Emperor Seiwa), specifically from the Hosokawa family which was a branch family of the Ashikaga clan following Kawachi-Genji.
家系は清和源氏の一家系　河内源氏の流れを汲む足利氏の庶流　細川氏。