In 1598, his all-too-lavish lifestyle brought the slanders of a civilian party including Mitsunari ISHIDA by which Hideyoshi confiscated his mansion that was said to be too luxury for his position and rank; but Sukezaemon, knowing it in advance, donated the grand mansion and belongings to his ancestral Daian-ji Temple before escaping to Luson with a Japanese quarter.
慶長3年（1598年）、あまりに華美な生活を好んだため、石田三成ら文治派の讒言によって、秀吉から身分をわきまえずに贅を尽くしすぎるとして邸宅没収の処分を受けることになるが、事前に察知してその壮麗な邸宅や財産を菩提寺の大安寺に寄進して日本人町のあるルソンへ脱出した。