In 1581 the subjugation of Inaba Province was completed with the surrender of Tottori-jo Castle, Toyonao who had worked under Shigekata KINOSHITA was awarded a landholding of Chizu no kori County with a stipend of 3,000 koku, thus reentering the Kageishi-jo Castle.
天正9年（1581年）に鳥取城が開城し、因幡平定が完了すると木下重堅の配下として智頭郡3000石が与えられ、再び景石城に入った。