@staticmethod
    def tokenize(sentence):
        return [x.strip() for x in re.split('(\W+)?', sentence) if x.strip()]
Split a sentence into tokens including punctuation.
dataset/ETHPy150Open NervanaSystems/neon/neon/data/questionanswer.py/BABI.tokenize