OPEA
/

Meta-Llama-3.1-8B-Instruct-int4-sym-inc

4-bit precision

intel/auto-round

Model card Files Files and versions Community

Meta-Llama-3.1-8B-Instruct-int4-sym-inc / model-00001-of-00002.safetensors

Commit History

add auto-gptq format

8fe2039

wenhuach commited on Nov 29, 2024