It is said, however, that he quarreled and parted ways with Ittetsu INABA in 1580, which resulted in him going into the service of Mitsuhide AKECHI, owing to their shared relationship of kinship.
しかし天正8年（1580年）に稲葉一鉄と喧嘩別れし、明智光秀との縁戚関係から光秀に仕えるようになったといわれている。