Umunosuke went to Kyoto in either 1863 or 1864, but was devastated when he learned that there were violent groups, who excluded foreigners in name only, and became Kishukunin (the boarder) (the soldier who was not Bakushin) who took care of Kyoto Mimawarigumi in order to punish those people by asking for the help of Sakuro MURATA, who was an acquaintance of his from when they were in Edo.
文久3年（1863年）または元治元年（1864年）、有無之助は京都へ行くが、攘夷とは名ばかりの暴徒が多いことに絶望、それらを懲らす志を立て江戸からの知人であった村田作郎を頼り、彼が肝煎を務める京都見廻組の寄宿人（幕臣ではない隊士）となる。