However, since Unpin offended the lord of the domain, Tadaaki SASAKI (the lord of the Obama domain, in Wakasa Province) for the reason that Unpin offered counsel to him, his hanseki was taken away.
しかし嘉永5年（1852年）、藩主・酒井忠義(若狭国小浜藩主)に建言したのが怒りに触れて、藩籍を剥奪された。