After being discharged from prison in 1863, he planed the Yamato gyoko (Imperial Trip to the Yamato Province) with court nobles of the Joi-ha (group advocating expelling barbarians), including Sanetomi SANJO and Izumi MAKI, however faced a setback with the Coup of August 18.
出獄後の文久3年（1863年）に三条実美ら攘夷派公卿や真木和泉と大和行幸を画策するが八月十八日の政変で挫折。