However, after Yoshinori ASHIKAGA became the sixth generation shogun Akihide never visited Kyoto - nor did he pay his respects to Yoshinori while the latter was touring Fuji in September 1432 and stayed at an inn in Yahagi which was close to his territory – and fell out of Yoshinori's favor.
しかし、足利義教が第6代将軍となってから一度も京都へ出仕せず、永享4年（1432年）9月の富士遊覧の際も所領に近い矢作宿に義教が宿泊しているにもかかわらず伺候しなかったため、義教の忌諱に触れた。