def tokenize(s):
    for (regexp, repl) in _tokenize_regexps:
        s = regexp.sub(repl, s)
    return s
Tokenize a string using the rule above
dataset/ETHPy150Open daeilkim/refinery/refinery/lib/word_tokenize.py/tokenize