In 1584, he departed both from Sadaijin and Kanpaku, and transferred them to Akizane NIJO (in the next year, Kanpaku soron (dispute over the kanpaku position) occurred with Nobutaka KONOE, but it was Hideyoshi TOYOTOMI who actually assumed the position of Kanpaku in the end).
天正12年（1584年）に左大臣・関白を辞し、二条昭実に譲る（翌年近衛信尹との間で関白相論となり、結局豊臣秀吉が関白となる）。