In 1607, when Ieyasu's eleventh son Yorifusa was put in Shimotsuma with 100,000 koku, Nobuyoshi was specifically ordered to attend Yorifusa and appointed as a Karo (chiefretainer; of 6,500 koku).
1607年、家康の11男頼房が下妻10万石に配されるに伴い、特に頼房に附属されて家老（6500石）に任じられる。