However, it is said that because he was annoyed by the overly intrusive attitude of his mother (as mentioned previously) and was opposed to his father Yoshimasa over his concubine (the daughter of Kimiari TOKUDAIJI), Yoshihisa escaped from his mother's house and moved to the residence of Sadamune ISE, the majordomo of Mandokoro (the Office of Administration).
しかし、母のこういった過干渉な態度は義尚にとってはうっとうしいものであったといわれ、側室（徳大寺公有の娘）をめぐって、父・義政と対立したことなどのために、母の家から義尚は逃げ出した形となり、政所執事である伊勢貞宗の屋敷に移っている。