During the Battle of Sekigahara, Toyonao himself did not go to the front, but he was punished by 'joho' sanction (also known as 'kaieki' which was shogunal sanction by means of sudden dismissal and deprivation of position, privileges and properties) for siding with the 'western' army.
関ヶ原の戦いでは自らは出陣しなかったものの、西軍に属したため除封となった。