He was later promoted to the position of Sadaijin (Minister of the Left), but when FUJIWARA no Mototsune came to power as Sessho (Regent) to Emperor Yozei and subsequently Dajo-daijin (Grand minister of State), there were concerns about conflicts in political authority with Mototsune, and he confined himself to his residences from 876 ("Sandai Jitsuroku" (sixth of the six classical Japanese history texts) and "Chuyuki" (Diary of a court official)).
後に左大臣に昇ったが、藤原基経が陽成天皇の摂政ついで太政大臣に任じられて政治の実権を握ったために、基経との政治的権限の衝突を恐れて貞観_(日本)18年（876年）頃より自宅に引籠もった（『三代実録』及び『中右記』）。