Hugging Face's logo

TitanML
/
Llama3-ChatQA-1.5-70B-AWQ-4bit

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
4-bit precision
awq
Model card Files Community

No model card

Downloads last month
7
Safetensors
Model size
11.3B params
Tensor type
I32
·
FP16
·
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Collections including TitanML/Llama3-ChatQA-1.5-70B-AWQ-4bit