However, once Yoshinori became a Shogun, Yoshisuke was ordered to shut himself up in his house, in addition to having two of his territories being confiscated, for allegedly having been disloyal to Yoshinori while Yoshinori was in Shorenin Monzeki Temple.
しかし、義教が将軍になると青蓮院門跡時代の義教に不忠の廉があったとして、所領を二ヶ所没収され、蟄居を命じられた。