Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
xmadai
/
Llama-3.1-70B-Instruct-xMADai-INT4
like
0
Follow
xMAD.ai
18
Text Generation
Transformers
llama
conversational
Inference Endpoints
4-bit precision
gptq
arxiv:
2407.10032
License:
llama3.1
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
085fd2d
Llama-3.1-70B-Instruct-xMADai-INT4
/
gptq_model-4bit-128g.safetensors
Commit History
Upload of AutoGPTQ quantized model
e6566ba
verified
Tianyi Zhang
commited on
Oct 30, 2024