Later, he served as a privy councilor, a member of the House of Peers, and a chairman of the House of Peers, but his political passion faded away as Japan prepared a modern legal system, and he left the political world early and tried to find 'his second life' in education.
後に枢密顧問官、貴族院議員次いで同副議長などを務めたが、日本が近代的な法制を整えるにつれてその政治的な情熱は影を潜めて、やがて早々と政界を引退して教育界に「第二の人生」を求めた。