In 1859, as Nagasaki Learning Place was closed due to Ansei no Taigoku (suppression of extremists by the Shogunate), he returned to Edo, worked in Warship Training Center, and became a crew of Kanrin Maru (the first Japanese ship ever to cross the Pacific) (he did not join the Kanrin Maru missionary to go to America).
1859年（安政6年）、安政の大獄により長崎伝習所が閉鎖されたのに伴い江戸に戻り、軍艦操練所に勤務し、咸臨丸の乗組員となる（咸臨丸渡米使節には参加者せず）。