His discourtesy made Masamichi TAKATSUKASA, Kanpaku (chief adviser to the Emperor), furious and Akiteru was dismissed from Kurodo in November 1847 and from other posts including Sashoben (Minor Controller of the Left) in January 1848. (The official record reads that he tendered his letter of resignation voluntarily.)
そのため、関白鷹司政通の怒りを買い、同年10月には蔵人を、12月には左少弁などの兼職を全て解任されて失脚した（表向きは自発的辞退）。