Transformers
GGUF
English
mistral
Generated from Trainer

which tool did you use

#1
by rinoa - opened

which tool did you use to convert zephyr-7B-alpha model into gguf?

I think he used llama-cpp and in particular the convert.py file, since there is not a specific script to convert zephyr to gguf (which is a mistral based model) yet. If you encounter any problem there is this issue or continue this thread.

deleted
This comment has been hidden
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment