Hugging Face's logo

budecosystem
/
code-millenials-3b

Text Generation
Transformers
PyTorch
mpt
code
custom_code
text-generation-inference
Inference Endpoints
Model card Files Community
1

Update boomer_code_tokenizer.py

#1
by mike-ravkine - opened
base: refs/heads/main
←
from: refs/pr/1
Discussion Files changed
+1
-1
mike-ravkine

Fix tokenizer for transformers >= 4.34

From https://github.com/InternLM/InternLM/pull/419

Update boomer_code_tokenizer.pydd3906fb
dittops changed pull request status to merged
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment