After the Meiji Restoration, he was pardoned thanks to the good offices of Kaishu KATSU, and relocated to Numazu, and in order to educate the children of former retainers of the bakufu, he made exhaustive efforts to establish the heigakko (Numazu officer academy), Sunto school for girls (present day West Numazu High School, Shizuoka Prefecture), as well as the Azabu Gakuen in Tokyo.
明治維新後に勝海舟の執り成しで罪を許されて沼津市へ移り住み、旧幕臣の子女への教育の為、沼津兵学校、駿東女学校（現・静岡県立沼津西高等学校）設立に尽力するとともに、東京に麻布学園を創設。