In 1454 he had a dispute with the eighth Shogun, Yoshimasa ASHIKAGA, over the position of the Akamatsu family and resigned from governmental affairs, taking up residence in Tajima.
1454年には赤松氏の出仕を巡り8代将軍足利義政と対立し、政務を引退して但馬へ下国。