In 1120 Tadazane lost his position of Chancellor and Nairan (an official position to check documents from the Grand Minister to the Emperor), he then had to retire to Uji.
保安元年（1120年）になって忠実は関白と兼職の内覧を罷免され、宇治隠居を余儀なくされた。