kaitchup
/

Llama-3.1-Minitron-4B-Depth-Base-AutoRound-GPTQ-asym-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Llama-3.1-Minitron-4B-Depth-Base-AutoRound-GPTQ-asym-4bit

Commit History

Upload LlamaForCausalLM

a361c3e
verified

bnjmnmarie commited on Aug 25, 2024

Upload tokenizer

4134a49
verified

bnjmnmarie commited on Aug 25, 2024

initial commit

c1fcb57
verified

bnjmnmarie commited on Aug 25, 2024