Offended by this remark, Hideyoshi demoted and transferred Nobusuke to Satsuma Province (he virtually banished him), and appointed Naidaijin Hidetsugu to Sadaijin as his replacement.
これが秀吉の怒りを買って文禄3年（1594年）に薩摩国に左遷（事実上の流罪）となり、後任の左大臣に内大臣の秀次が任じられた。