Later, in 1585, he became the chief vassal of Hideyoshi's nephew, Hidetsugu TOYOTOMI, and later became the lord of Takahama-jo Castle, Wakasa Province; before long, he became the lord of Omi Nagahama-jo Castle (Omi Province) and received 20,000 koku.
この後秀吉の甥・豊臣秀次の宿老となり天正13年（1585年）には若狭国高浜城主、まもなく近江長浜城(近江国)主となり2万石を領した。