He later participated as a close servant to the Retired Emperor Goshirakawa and became a Gon dainagon (Provisional Major Councilor), working as Naidaijin (Great Minister of the Centre), and was promoted to Daijodaijin, who had a Juichii rank (Junior First Rank) in 1177.
その後は後白河法皇の側近として活躍して権大納言となり、内大臣を経て1177年には従一位太政大臣に昇進する。