Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

compressed-tensors

Inference Endpoints

text-generation-inference

AutoTrain Compatible

8-bit precision

Mixture of Experts

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Models

1,003

Full-text search

Active filters: compressed-tensors

nm-testing/whisper-large-v3.w4a16

Automatic Speech Recognition • Updated Feb 14 • 33 • 1

yeyaowei/L3.3-San-Mai-R1-70b-FP8-Dynamic

Updated Feb 20 • 33 • 1

yeyaowei/L3.3-Cu-Mai-R1-70b-FP8-Dynamic

Updated Feb 20 • 38 • 1

BigHuggyD/LatitudeGames_Wayfarer-Large-70B-Llama-3.3-FP8-Dynamic

Text Generation • Updated about 1 month ago • 158 • 1

reinforce20001/SakuraLLM.Sakura-14B-Qwen2.5-v1.0-W8A8-Int8-V2

Updated 29 days ago • 312 • 3

cortecs/r1-1776-distill-llama-70b-FP8-Dynamic

Text Generation • Updated 24 days ago • 190 • 2

ig1/QwQ-32B-FP8-Dynamic

Updated 17 days ago • 246 • 1

cortecs/QwQ-32B-FP8-Dynamic

Updated 16 days ago • 478 • 1

SanXM1/Driftwood-12b-FP8

Updated 15 days ago • 5 • 1

leon-se/gemma-3-12b-it-FP8-Dynamic

Updated 10 days ago • 836 • 4

qingy2024/Reka-Flash-3-21B-FP8-dynamic

Text Generation • Updated 10 days ago • 4 • 1

abhishekchohan/gemma-3-12b-it-quantized-W4A16

Image-Text-to-Text • Updated 6 days ago • 242 • 1

nm-testing/tinyllama-one-shot-static-quant-test-compressed

Text Generation • Updated Oct 9, 2024 • 16

nm-testing/tinyllama-one-shot-dynamic-test

Text Generation • Updated Oct 9, 2024 • 8

nm-testing/tinyllama-one-shot-w4a16-group-packed

Text Generation • Updated Oct 10, 2024 • 9

nm-testing/tinyllama-one-shot-w4a16-channel-compressed

Text Generation • Updated Oct 9, 2024 • 9

nm-testing/tinyllama-one-shot-w4a16-channel-packed

Text Generation • Updated Oct 9, 2024 • 11

nm-testing/llama7b-one-shot-2_4-w4a16-packed

Text Generation • Updated Oct 9, 2024 • 8

nm-testing/tinyllama-one-shot-w4a16-group128-packed

Text Generation • Updated Oct 9, 2024 • 13

nm-testing/llama3-8b-w8_channel-a8_tensor-compressed

Text Generation • Updated Oct 9, 2024 • 6

nm-testing/llama7b-one-shot-2_4-w4a16-marlin24

Text Generation • Updated Jun 4, 2024 • 9

nm-testing/llama7b-one-shot-2_4-w4a16-group128-packed

Text Generation • Updated Jun 4, 2024 • 9

nm-testing/llama1.1b_0.5_sparse_bitmask

Text Generation • Updated Oct 9, 2024 • 8

nm-testing/llama7b-one-shot-2_4-w4a16-marlin24-t

Text Generation • Updated Oct 9, 2024 • 5.74k • 1

nm-testing/tinyllama-one-shot-w8a8-dynamic-channel

Text Generation • Updated Oct 9, 2024 • 9

nm-testing/llama7b-one-shot-2_4-w4a16-marlin24-t-alt

Text Generation • Updated Oct 9, 2024 • 10

nm-testing/tinyllama-marlin24-w4a16-group128

Text Generation • Updated Oct 9, 2024 • 11

nm-testing/tinyllama-oneshot-w8a8-static-v2

Text Generation • Updated Oct 9, 2024 • 8

nm-testing/tinyllama-oneshot-w8a8-dynamic-token-v2

Text Generation • Updated Oct 9, 2024 • 3.25k

nm-testing/tinyllama-oneshot-w8a8-static-v3

Text Generation • Updated Jun 17, 2024 • 6