Hugging Face's logo

mistral-community
/
Mixtral-8x22B-v0.1

Text Generation
Transformers
Safetensors
mixtral
Mixture of Experts
Eval Results
text-generation-inference
Inference Endpoints
Model card Files Community
19

GGUF quants available here

#11
by andrijdavid - opened
Discussion
andrijdavid

The GGUF is available here. I had to split it due to the size. Tested using Llama.cpp
https://huggingface.co/andrijdavid/Mixtral-8x22B-v0.1-GGUF/

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment