At the Battle of Yamasaki in which Yoritaka participated following Nobutaka, when Mitsuhide died and consequently Katsuie SHIBATA and Nobutaka ODA fought against Hideyoshi, Yoritaka served Hideyoshi TOYOTOMI and participated in the attack on Gifu-jo Castle of Nobutaka ODA.
山崎の合戦には、信孝に従い参戦しているが、光秀が死に柴田勝家・織田信孝が秀吉と敵対すると、豊臣秀吉に属し、織田信孝の岐阜城攻めに加わっている。