Update tokenizer_config.json

#8
by ykhwang - opened

Closing this PR since there are additional changes in eos_token settings, so I'll create a new PR addresses all the diffs

ykhwang changed pull request status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment