human
How can I split a string into tokens?
assistant
Here is some code to split string 'x+13.5*10x-4e1' into tokens

print([i for i in re.split('([\\d.]+|\\W+)', 'x+13.5*10x-4e1') if i])

#Warning: this code generation is experimental. Please inspect the code for any bugs before executing.