Those who left the group were 5 Mito roshis (masterless samurai) including Serizawa, Niimi and 8 disciples of Shieikan including Kondo, Toshizo HIJIKATA, Keisuke YAMANAMI, Soji OKITA and also some other people including Yoshio TONOUCHI, Yuzan NEGISHI, Shingoro KASUYA joined them, but they had an internal conflict soon, by which Tonouchi, Negishi, Kasuya and others were murdered or left the group.
離脱組は芹沢、新見ら5人の水戸系浪士と近藤、土方歳三、山南敬助、沖田総司ら8人の試衛館門人で、これに殿内義雄、根岸友山、粕谷新五郎らが加わるがすぐに内部抗争が起きて殿内、根岸、粕谷らは謀殺・脱退した。