Update chat_template.jinja to match tokenizer_config.json

#5
by nbroad - opened
No description provided.

@rshcao

I believe AutoTokenizer loads from chat_template.jinja, rather than tokenizer_config.json

It might be better to only have one or the other rather than maintaining both. It seems like chat_template.jinja is the newer way to do things

Sorry for the mismatched chat template content. I did not notice that in this FP8 model, there is also a chat_template.jinja file.

The chat_template field in the tokenizer_config.json is an updated one than chat_template.jinja file, which should fix some Jinja version problems.

We are still in the process of collecting issues where the community uses the XML-tool-call chat template, and will

update a newer version of both the chat template and tool parser as soon as possible.

Cannot merge
This branch has merge conflicts in the following files:
  • chat_template.jinja

Sign up or log in to comment