Yoshifusa became Shugodai (deputy military governor) of Takauji ASHIKAGA who was Shugo (military governor) in Suruga province and Izu province in 1334, and was appointed to the position of shugoshiki (post of provincial constable) in Suruga and Izu in 1336.
1334年に駿河国・伊豆国守護足利尊氏の守護代となり、1336年（延元元年/建武(日本)3年）に駿河と伊豆の守護職に就任。