However, in addition to the fact that he returned the two Korean princes as a bargaining chip during negotiations, he had a confrontation in 1596 with Mitsunari ISHIDA over a peace settlement with Ming, for which he incurred the displeasure of Hideyoshi and was temporarily brought back to Kyoto.
しかし交渉材料に朝鮮二王子を返還してしまうなど、慶長元年（1596年）、石田三成と明との和睦をめぐって意見の対立が生じ、それが元で秀吉の勘気を受けて一時は京都に戻される。