He was the heir of the Yasutomi clan who succeeded the deputy of provincial constable of the east Sanuki Province as a senior vassal serving the Hosokawa-Keicho family.
細川京兆家の重臣として讃岐国東方守護代を世襲していた安富氏の惣領である。