gurro/llama-3.1-8B-torchao-int4wo-256
Text Generation
•
Updated
•
11
Edit Models filters
Inference Providers
Active filters:
torchao
jerryzh168/llama3-8b-autoquant
Text Generation
•
Updated
•
118
medmekk/Llama-3.1-8B-Instruct-torchao-int8_weight_only
Updated
•
11
medmekk/Llama-3.1-8B-Instruct-torchao-int8wo
Updated
•
10
medmekk/Llama-3.1-8B-Instruct-torchao-int8da8w
Updated
•
8
medmekk/Llama-3.2-3B-Instruct-torchao-int8wo
Updated
•
8
medmekk/Llama-3.2-1B-torchao-int8wo
Updated
•
8
medmekk/Llama-3.2-1B-torchao-int8da8w
Updated
•
8
medmekk/Llama-3.2-3B-Instruct-torchao-int8da8w
Updated
•
9
medmekk/Llama-3.1-70B-Instruct-torchao-int8da8w
Updated
•
7
jerryzh168/Meta-Llama-3-8B-torchao-int8_weight_only
Updated
•
13
jerryzh168/Meta-Llama-3-8B-torchao-int4_weight_only-gs_128
Updated
•
11
jerryzh168/Meta-Llama-3-8B-torchao-int4_weight_only-gs_64
Updated
•
11
HF-Quantization/Llama-3.2-1B-TORCHAO-W8
Updated
•
18
HF-Quantization/Llama-3.2-1B-TORCHAO-W8A8
Updated
•
12
HF-Quantization/Llama-3.2-1B-TORCHAO-W4
Updated
•
17
HF-Quantization/Llama-3.3-70B-Instruct-TORCHAO-W4
Updated
•
17
jpablomch/Meta-Llama-3-8B-Instruct-torchao
Text Generation
•
Updated
•
23
jerryzh168/llama3-8b-int4wo-128
Text Generation
•
Updated
•
58
jerryzh168/llama3-8b-int8wo
Text Generation
•
Updated
•
56
alpindale/Meta-Llama-3-8B-torchao-int8_weight_only
Updated
•
47
drisspg/f8a8-opt-125m
Text Generation
•
Updated
•
74
drisspg/f8a8-opt-125m_2
Text Generation
•
Updated
•
73