Eval request
CohereForAI/c4ai-command-a-03-2025
hmm I get "Error loading model: Encountered unknown tag 'break'. Jinja was looking for the following tags: 'endif'. The innermost block that needs to be closed is 'if'." when trying to run it.
Well...I haven't actually tried it myself...I was waiting to see how it scored before I even bothered...
Seconded, I'd like to see this one evaluated too.
Error likely because of the new arch. I got a similar error when first trying to load the model before I updated my model loader.
Thirded. If you're using KoboldCPP, it should be supported with the latest update.
Thirded. If you're using KoboldCPP, it should be supported with the latest update.
Currently using llama-cpp-python. Don't see any mention on if it's supported. I only see https://github.com/ggml-org/llama.cpp/issues/12441
I'm currently using oobabooga's text-gen-webui with llama-cpp-python 0.3.8 as the backend. Looks like compatibility was just added in 0.3.8