xmadai
/

Llama-3.1-70B-Instruct-xMADai-INT4

Text Generation

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Llama-3.1-70B-Instruct-xMADai-INT4 / quantize_config.json

Commit History

Upload of AutoGPTQ quantized model

e6566ba
verified

Tianyi Zhang commited on Oct 30, 2024