Wrong Jija Format!
Hi,
I tested the model in LM Studio, and it works. However, I was getting a Jija error message. The Jija code shipped with the GGUF is incomplete. I replaced it with the official Jija format:
{% for message in messages %}{{'<|im_start|>' + message['role'] + '
'}}{% if message['content'] is string %}{{ message['content'] }}{% else %}{% for content in message['content'] %}{% if content['type'] == 'image' %}{{ '
' }}{% elif content['type'] == 'video' %}{{ '
Hmm i didnt want to convert all the text parts myself so i used gguf my repo which didnt include the template which is why i readded that part, can you tell me which quant you used exactly? Maybe i made a mistake with one
okay seems like i had a typo or something in some of the templates, ill run a colab script to fix that (;
in the meantime you can use
{% for message in messages %}{{'<|im_start|>' + message['role'] + ' '}}{% if message['content'] is string %}{{ message['content'] }}{% else %}{% for content in message['content'] %}{% if content['type'] == 'image' %}{{ '<image> ' }}{% elif content['type'] == 'video' %}{{ '<video> ' }}{% elif content['type'] == 'text' %}{{ content['text'] }}{% endif %}{% endfor %}{% endif %}{{'<|im_end|> '}}{% endfor %}{% if add_generation_prompt %}{{'<|im_start|>assistant ' }}{% endif %}
That one should work fine and is the original one