he felt it was a perversion of his learning and all he taught , but he knew , without doubt , that these men constituted a serious threat to myme chlo , nor could they be allowed to return from whence they came .