Later, he became an adopted heir of the Shiji family (upper-class samurai, 250 koku), a feudal retainer of Choshu Domain, but reenrolled in the Inoue family again.
のち、長州藩士・志道家（大組・250石）の養嗣子となるも、のち井上家に復籍。