In 1578, when Kanetomo OCHIAI, the lord of Takanabe-jo Castle on the side of the Ito clan shifted sides to the Shimazu family, Tadatomo was appointed the lord of Takarabe-jo Castle.
天正6年（1578年）伊東氏の高鍋城城主・落合兼朝が島津家に寝返ると、忠智は財部城主に任命される。