Concerning his withdrawal from the alliance, he and Sezaemon drew the lottery in order to decide which of them would withdraw from the alliance because one of them had to look after their mother, according to anecdotes.
この脱盟について自分か瀬左衛門のどちらかは生母の面倒を見ねばならないということで瀬左衛門とくじでどちらが脱盟するか決めたという逸話がある。