It is believed that he fell from power due to a scheme plotted by FUJIWARA no Munenari, who was manipulated by FUJIWARA no Nakanari of the Ceremonial House of the Fujiwara clan, a close advisor of Emperor Heizei who was the older half-brother (by the same father) of Imperial Prince Iyo.
異母兄平城天皇の側近であった藤原式家・藤原仲成に操られた藤原宗成に失脚させられたものとされる。