Nobuyoshi, however, was condemned for having disobeyed a military command and was thereby being placed under house arrest at Agatsuma in Kozuke Province, and when he was pardoned, he was promoted to one of the oban kumigashira (captains of the great guards), before his death on February 26, 1610, in Fushimi, Yamashiro Province.
しかし軍令違反を咎められ、一時上野国吾妻に蟄居させられたが、後に赦免され大番、組頭にすすみ、慶長15年2月3日（1610年2月26日）、山城国伏見にて没した。