It is said that his relationship with Mitsunari ISHIDA became worse as the civilian government group and the military government group were gradually formed under the Toyotomi government, and his relationship with Yukinaga KONISHI was characterized by a scramble to be first in the advance guard in the dispatching of troops to Korea and by frequent conflicts over the borderline of their adjoining territories.
石田三成とは豊臣政権下で文治派、武断派が形成されるにつれて関係が悪化し、小西行長とは朝鮮出兵の際に先鋒をめぐって争ったことや互いの領地が隣り合わせであったため常に境界線をめぐって争ったとも言われている。