Eval request

#202
by BigHuggyD - opened

CohereForAI/c4ai-command-a-03-2025

hmm I get "Error loading model: Encountered unknown tag 'break'. Jinja was looking for the following tags: 'endif'. The innermost block that needs to be closed is 'if'." when trying to run it.

Well...I haven't actually tried it myself...I was waiting to see how it scored before I even bothered...

Seconded, I'd like to see this one evaluated too.
Error likely because of the new arch. I got a similar error when first trying to load the model before I updated my model loader.

Thirded. If you're using KoboldCPP, it should be supported with the latest update.

Thirded. If you're using KoboldCPP, it should be supported with the latest update.

Currently using llama-cpp-python. Don't see any mention on if it's supported. I only see https://github.com/ggml-org/llama.cpp/issues/12441

I'm currently using oobabooga's text-gen-webui with llama-cpp-python 0.3.8 as the backend. Looks like compatibility was just added in 0.3.8

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment