Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

compressed-tensors

Inference Endpoints

text-generation-inference

AutoTrain Compatible

8-bit precision

Mixture of Experts

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Models

1,004

Full-text search

Active filters: compressed-tensors

nm-testing/DeepSeek-R1-Distill-Qwen-14B-W8A8-Dynamic-Per-Token

Updated Jan 26 • 11

nm-testing/granite-8b-code-instruct-128k-FP8-Dynamic

Updated Jan 26 • 7

nm-testing/DeepSeek-R1-Distill-Qwen-14B-W4A16-G128

Updated Jan 26 • 7

nm-testing/Mistral-7B-Instruct-v0.3-FP8-Dynamic

Updated Jan 26 • 7

nm-testing/DeepSeek-R1-Distill-Qwen-14B2of4-sparse

Updated Jan 26 • 7

nm-testing/DeepSeek-R1-Distill-Qwen-14B2of4-W8A8-FP8-Dynamic-Per-Token

Updated Jan 26 • 7

nm-testing/granite-3.1-8b-instruct-W8A8-Dynamic-Per-Token

Updated Jan 26 • 7

nm-testing/granite-3.1-8b-instruct-W4A16-G128

Updated Jan 26 • 7

nm-testing/granite-8b-code-instruct-128k-W8A8-Dynamic-Per-Token

Updated Jan 26 • 7

nm-testing/granite-8b-code-instruct-128k-W4A16-G128

Updated Jan 26 • 9

nm-testing/Mistral-7B-Instruct-v0.3-W8A8-Dynamic-Per-Token

Updated Jan 26 • 7

nm-testing/Mistral-7B-Instruct-v0.3-W4A16-G128

Updated Jan 26 • 10

nm-testing/granite-3.1-8b-instruct2of4-sparse

Updated Jan 26 • 10

nm-testing/granite-3.1-8b-instruct2of4-W8A8-FP8-Dynamic-Per-Token

Updated Jan 26 • 8

nm-testing/granite-8b-code-instruct-128k2of4-sparse

Updated Jan 26 • 9

nm-testing/granite-8b-code-instruct-128k2of4-W8A8-FP8-Dynamic-Per-Token

Updated Jan 26 • 8

nm-testing/Mistral-7B-Instruct-v0.32of4-sparse

Updated Jan 26 • 8

nm-testing/Mistral-7B-Instruct-v0.32of4-W8A8-FP8-Dynamic-Per-Token

Updated Jan 26 • 8

nexa-collaboration/output_llama3.1_8b_2of4_stage_sparsity_0.9

Updated Jan 27 • 9

nexa-collaboration/output_llama3.1_8b_2of4_stage_finetuning_0.9

Updated Jan 27 • 8

nexa-collaboration/output_llama3.1_8b_2of4_stage_quantization_0.9

Updated Jan 27 • 7

SicariusSicariiStuff/Impish_QWEN_14B-1M_FP8

Updated Jan 27 • 18

SicariusSicariiStuff/Impish_QWEN_7B-1M_FP8

Updated Jan 27 • 5

leon-se/Qwen2.5-VL-7B-Instruct-FP8-Dynamic

Updated 23 days ago • 8.46k

JamAndTeaStudios/gemma-2-9b-it-FP8-Dynamic

Text Generation • Updated Jan 29 • 20

nejumi/Qwen2.5-14B-Instruct-1M-W8A8-calib-ja-1k

Updated Jan 28 • 9

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-sparse24-layer-0-fp8-compressed

Updated Jan 28 • 9

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-sparse24-layer-0-5-fp8-compressed

Updated Jan 28 • 7

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-sparse24-0-5-remaining-fp8-compressed

Updated Jan 28 • 9

JamAndTeaStudios/DeepSeek-R1-Distill-Qwen-1.5B-FP8-Dynamic

Text Generation • Updated Jan 29 • 47