def wikitext_split(text):
    return re.findall(
        r"[\w]+|\[\[|\]\]|\{\{|\}\}|\n+| +|&\w+;|'''|''|=+|\{\||\|\}|\|\-|.",
        text
    )
Performs the simplest possible split of latin character-based languages
dataset/ETHPy150Open mediawiki-utilities/python-mediawiki-utilities/mw/lib/persistence/tokenization.py/wikitext_split