Edit Models filters

Misc

compressed-tensors

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

781

Full-text search

Active filters: compressed-tensors

qeternity/DeepSeek-R1-Distill-Qwen-32B-FP8

Updated 11 days ago • 423 • 2

qeternity/DeepSeek-R1-Distill-Llama-8B-FP8

Updated 11 days ago • 26 • 2

qeternity/DeepSeek-R1-Distill-Qwen-7B-FP8

Updated 11 days ago • 29 • 2

qeternity/DeepSeek-R1-Distill-Qwen-1.5B-FP8

Updated 11 days ago • 56 • 2

getfit/DeepSeek-R1-Distill-Qwen-32B-FP8-Dynamic

Updated 11 days ago • 637 • 3

neuralmagic-ent/Llama-3.3-70B-Instruct-quantized.w8a8

Text Generation • Updated 8 days ago • 429 • 2

predibase/DeepSeek-R1-Distill-Qwen-32B-FP8-Dynamic

Updated 10 days ago • 17 • 1

enferAI/DeepSeek-R1-Distill-Qwen-14B-FP8

Text Generation • Updated 9 days ago • 96 • 1

cortecs/DeepSeek-R1-Distill-Qwen-32B-FP8-Dynamic

Updated 8 days ago • 204 • 1

nm-testing/tinyllama-one-shot-static-quant-test-compressed

Text Generation • Updated Oct 9, 2024 • 78

nm-testing/tinyllama-one-shot-dynamic-test

Text Generation • Updated Oct 9, 2024 • 82

nm-testing/tinyllama-one-shot-w4a16-group-packed

Text Generation • Updated Oct 10, 2024 • 76

nm-testing/tinyllama-one-shot-w4a16-channel-compressed

Text Generation • Updated Oct 9, 2024 • 77

nm-testing/tinyllama-one-shot-w4a16-channel-packed

Text Generation • Updated Oct 9, 2024 • 76

nm-testing/llama7b-one-shot-2_4-w4a16-packed

Text Generation • Updated Oct 9, 2024 • 76

nm-testing/tinyllama-one-shot-w4a16-group128-packed

Text Generation • Updated Oct 9, 2024 • 76

nm-testing/llama3-8b-w8_channel-a8_tensor-compressed

Text Generation • Updated Oct 9, 2024 • 7

nm-testing/llama7b-one-shot-2_4-w4a16-marlin24

Text Generation • Updated Jun 4, 2024 • 77

nm-testing/llama7b-one-shot-2_4-w4a16-group128-packed

Text Generation • Updated Jun 4, 2024 • 82

nm-testing/llama1.1b_0.5_sparse_bitmask

Text Generation • Updated Oct 9, 2024 • 78

nm-testing/llama7b-one-shot-2_4-w4a16-marlin24-t

Text Generation • Updated Oct 9, 2024 • 4.84k • 1

nm-testing/tinyllama-one-shot-w8a8-dynamic-channel

Text Generation • Updated Oct 9, 2024 • 77

nm-testing/llama7b-one-shot-2_4-w4a16-marlin24-t-alt

Text Generation • Updated Oct 9, 2024 • 76

nm-testing/tinyllama-marlin24-w4a16-group128

Text Generation • Updated Oct 9, 2024 • 79

nm-testing/tinyllama-oneshot-w8a8-static-v2

Text Generation • Updated Oct 9, 2024 • 78

nm-testing/tinyllama-oneshot-w8a8-dynamic-token-v2

Text Generation • Updated Oct 9, 2024 • 6.4k

nm-testing/tinyllama-oneshot-w8a8-static-v3

Text Generation • Updated Jun 17, 2024 • 134

nm-testing/tinyllama-oneshot-w8a8-dynamic-token-v3

Text Generation • Updated Jun 17, 2024 • 80

nm-testing/tinyllama-oneshot-w4a16-group128-v2

Text Generation • Updated Oct 9, 2024 • 4.67k

nm-testing/tinyllama-oneshot-w4a16-group128-v3

Text Generation • Updated Aug 19, 2024 • 9