After returning to Japan, he successively held posts as the second-ranked shusshi (a supernumerary government official) of the Ministry of Foreign Affairs, gaimu-taifu (a post in the Foreign Ministry), gijokan (a post in the Decoration Bureau), kaigunkyo (the chief of the navy), goyo-gakari (a government official assigned to perform a certain task) in the construction of the Imperial Palace, jimu fuku-sosai (a vice-secretary-general) in the construction of the Imperial Palace, a minister to Shin (China), and goyo-gakari in the investigation of the revision of a treaty; after the cabinet system was established, due to his ability, he assumed the ministership in six Cabinets in a row as the Minister of Communication, the Minister of Education, the Minister of Foreign Affairs, the Minister of Commerce and Agriculture (between the Minister of Education and the Minister of the Foreign Affairs, he assumed the membership of the Privy Council [Japan]).
帰国後は外務省二等出仕、外務大輔、議定官、海軍卿、皇居御造営御用掛、皇居御造営事務副総裁、駐清公使、条約改正取調御用掛等を歴任し、内閣制度の成立後は能力を買われ6度の内閣で連続して、逓信大臣、文部大臣、外務大臣、農商務大臣を歴任した（文相・外相の前後に枢密院(日本)就任）。