Even after Naosuke was assassinated in the Sakuradamongai Incident in 1860, he continued serving as a Sobayaku (Secretary) of Naonori II who assumed the post of the lord of domain.
安政7年（1860年）直弼が桜田門外の変で暗殺された後も藩主に就任した井伊直憲に引き続き側役として仕えた。