On December 24, 1464, Yoshihiro made up his mind to return to secular life as Yoshimasa had even prepared a written oath "Even if a son is born to me, I will make him become a Buddhist priest and not allow him to succeed the headship of the family" and tried to persuade Yoshihiro once again to inherit the office of Shogun; renaming himself Yoshimi ASHIKAGA, the younger brother decided to move to the Imadegawa residence under the guardianship of Katsumoto.
1464年12月24日（寛正5年11月26日）、義尋は、義政が『今後男子が生まれても僧門に入れ、家督を継承させることはない』と起請文までしたため、再三、将軍職就任を説得したことから、意を決して還俗し名を足利義視と改めると勝元の後見を得て今出川邸に移ることにした。