Hugging Face's logo

AtlaAI
/
Selene-1-Mini-Llama-3.1-8B-GPTQ-W4A16

Text Generation
Transformers
Safetensors
llama
atla
evaluation
llm-as-a-judge
meta
conversational
lm-judge
llama-cpp
gptq
text-generation-inference
Inference Endpoints
compressed-tensors
Model card Files Community
Selene-1-Mini-Llama-3.1-8B-GPTQ-W4A16 / recipe.yaml
kaikaidai's picture
kaikaidai
Upload recipe.yaml with huggingface_hub
a7feadc verified
raw
history blame
150 Bytes
DEFAULT_stage:
DEFAULT_modifiers:
GPTQModifier:
sequential_update: true
scheme: W4A16
targets: Linear
ignore: [lm_head]