It is said that he failed to attain the position of a minister because the Fujiwara family had kept an eye on him for fear of his fame in his later life.
晩年はその名声を恐れた藤原氏に警戒の目を向けられたために、ついに大臣の地位に上ることがなかったと言われている。