However, when Michiie KUJO fell from power in the series of political turmoil since Miya-sodo (ailed attempt at rebellion) in 1246 and the Retired Emperor Gosaga began Insei (rule by a retired emperor) supported by the Kamakura bakufu, he was kept out of the political arena and retired from office in 1250 in frustration.
だが、寛元4年（1246年）の宮騒動以来の一連の政変で九条道家が失脚、同年に鎌倉幕府の支援を受けた後嵯峨上皇の院政が始まると政界から排斥され、失意のうちに建長2年（1250年）に官を退いた。