def tokenize(s, *args, **kwargs):
    return parser.find_tokens(s, *args, **kwargs)
Decompresses a list of strings compressed by prefix_encode().
dataset/ETHPy150Open clips/pattern/pattern/text/nl/__init__.py/tokenize--crossover with--dataset/ETHPy150Open tallstreet/Whoosh-AppEngine/src/whoosh/util.py/prefix_decode_all