Add missing merge to tokenizer

#50
sanchit-gandhi changed pull request status to merged
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment