When his brother Yorimoto HOSOKAWA succeeded Yoshimasa SHIBA as Kanrei, Yoriyuki assisted with government affairs and returned to the shogunate administration as a senior retainer.
後任の管領に弟の細川頼元が就任すると、頼之は政務を後見し、宿老として幕政に復帰した。