CohereLabs/aya-expanse-32b
#7
by
Theteux
- opened
https://huggingface.co/CohereLabs/aya-expanse-32b
Could you please provide quant in exl3 format, would like to run it on a 16GB gpu need a quant around 3.25 BPW i guess
many thanks
Sorry, I don't generally do gated models unless an ungated fork is available on HF
ArtusDev
changed discussion status to
closed