On January 3, 1868, the Decree for the Restoration of Imperial Rule ('Osei Fukko no Daigorei' in Japanese) was issued, whereby members of the Kobu Gattai-ha party (supporting the policy of Kobu Gattai, "Unity of Court and Bakufu") including him were banned from the imperial palace.
慶応3年12月9日（1868年1月3日）に王政復古の大号令が発せられ、公武合体派であることを理由に参内を停止された。