Hugging Face's logo

Orion-zhen
/
aya-expanse-32b-AWQ

Text Generation
Transformers
Safetensors
cohere
conversational
text-generation-inference
Inference Endpoints
4-bit precision
awq
Model card Files Community
1

aya-expanse-32b-AWQ

AWQ quantization of CohereForAI/aya-expanse-32b

Downloads last month
583
Safetensors
Model size
8.23B params
Tensor type
I32
·
FP16
·
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported Inference Providers.

Model tree for Orion-zhen/aya-expanse-32b-AWQ

Base model

CohereForAI/aya-expanse-32b
Quantized
(20)
this model