GGUF imatrix quants available
#1
by
ddh0
- opened
A set of several imatrix GGUF quants will be available at https://huggingface.co/ddh0/Unnamed-Exp-70b-v0.6.A-GGUF/ starting in a few hours, and I'll update this discussion when they're all done. Thank you for the model! 🤗
ddh0
changed discussion title from
GGUF imatrix quants incoming
to GGUF imatrix quants available