In 1478, his father, Yoshinao, was allowed to enter the service of the bakufu and, thanks to his support, Yoshiharu was involved in the administration by the bakufu but died on October 2, 1484.
文明10年（1478年）、父義直の幕府出仕が認められ、その後見を得て幕政に参与したが、文明16年（1484年）9月4日病死した。