Later Katsumasa was ordered to be the lord of the Harada-jo Castle by Nobunaga to compete with Murashige's force which was on the side of Miyoshi Sanninshu, and he moved from place to place with Yusai HOSOKAWA to fight but after Murashige ARAKI became a retainer of Nobunaga, Katsumasa went into retirement at Ikeda (It is also said that Katsumasa traveled to the Kyushu region).
その後、三好三人衆についた村重らの押さえとして信長より原田城城主に任じられ細川幽斎らとともに各地を転戦したが、荒木村重が信長家臣になると池田に戻り隠居した（諸国を旅し、九州へ渡ったとも言われている）。