Going to Kyoto, which in those days was the place where most of the Imperialists under the slogan of 'Sonno Joi ha' (supporters of the doctrine of restoring the emperor and expelling the barbarians) hid themselves, was dangerous for Shozan, who gave the impression of being a 'Westernized' person in those days, (he even walked in Kyoto without any attendants).
しかし当時の京都は尊皇攘夷派の志士の潜伏拠点となっており、「西洋かぶれ」という印象を持たれていた象山には危険な行動であった（しかも京都の街を移動する時に供も連れなかった）。