However, in 1757, the Edo bakufu (Japanese feudal government headed by a shogun) put pressure on him for his misconduct that he appointed Shikibu TAKENOUCHI the tutor of the Emperor Momozono; For, Shikibu TAKEUCHI, who was a vassal of the Tokuraiji family, supported a theory that the Imperial Court should retrieve their political power; This incident forced Kinmura TOKUDAIJI to resign the position and to be suspended (the Horeki Incident).
しかし宝暦7年（1757年）、朝廷への権力回帰の学説を主張した徳大寺家家臣竹内式部を桃園天皇の侍講につけた件で幕府から圧力がかかり、官職を辞して蟄居することとなった（宝暦事件）。