Edit Models filters

Model Tree

deepseek-ai/DeepSeek-R1-Distill-Llama-70B

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

54

Full-text search

Active filters: deepseek-ai/DeepSeek-R1-Distill-Llama-70B

unsloth/DeepSeek-R1-Distill-Llama-70B-bnb-4bit

Text Generation • Updated Feb 14 • 3.47k • 20

unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF

Updated Jan 29 • 44.8k • 76

WaveCut/deepseek-ai_DeepSeek-R1-Distill-Llama-70B_MLX-4bit

Updated Jan 20 • 33 • 1

bartowski/DeepSeek-R1-Distill-Llama-70B-GGUF

Text Generation • Updated Jan 22 • 13.2k • 33

lmstudio-community/DeepSeek-R1-Distill-Llama-70B-GGUF

Text Generation • Updated Jan 20 • 14k • 2

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q3_K_M-GGUF

Text Generation • Updated Jan 20 • 81 • 1

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q4_0-GGUF

Text Generation • Updated Jan 20 • 245 • 1

zhitels/DeepSeek-R1-Distill-Llama-70B-4bit

Updated Jan 20 • 46 • 1

Valdemardi/DeepSeek-R1-Distill-Llama-70B-AWQ

Text Generation • Updated Jan 20 • 10.6k • 16

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q6_K-GGUF

Text Generation • Updated Jan 21 • 46 • 1

mradermacher/DeepSeek-R1-Distill-Llama-70B-GGUF

Updated Jan 23 • 1.6k • 2

mlx-community/DeepSeek-R1-Distill-Llama-70B-4bit

Text Generation • Updated 30 days ago • 932 • 5

mlx-community/DeepSeek-R1-Distill-Llama-70B-3bit

Text Generation • Updated 30 days ago • 279 • 4

mradermacher/DeepSeek-R1-Distill-Llama-70B-i1-GGUF

Updated Jan 23 • 775 • 2

second-state/DeepSeek-R1-Distill-Llama-70B-GGUF

Text Generation • Updated Jan 22 • 1.88k • 1

featherless-ai-quants/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-GGUF

Text Generation • Updated Jan 21 • 273 • 1

unsloth/DeepSeek-R1-Distill-Llama-70B-unsloth-bnb-4bit

Text Generation • Updated Feb 14 • 2.41k • 8

nm-testing/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic

Text Generation • Updated Feb 1 • 243 • 3

maus/DeepSeek-R1-Distill-Llama-70B-Q4-mlx

Text Generation • Updated Jan 31 • 145 • 3

neuralmagic/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic

Text Generation • Updated 29 days ago • 106k • 7

novita/DeepSeek-R1-Distill-Llama-70B-w8a8kv8-s888

Updated Feb 7 • 12 • 2

neuralmagic/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8

Text Generation • Updated 29 days ago • 1.38k • 1

matatonic/r1-1776-distill-llama-70b-6.5bpw-h8-exl2

Updated Feb 22 • 35 • 3

OPEA/DeepSeek-R1-Distill-Llama-70B-int4-gptq-sym-inc

Updated 25 days ago • 182 • 1

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q2_K-GGUF

Text Generation • Updated Jan 20 • 66

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q3_K_S-GGUF

Text Generation • Updated Jan 20 • 768

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q3_K_L-GGUF

Text Generation • Updated Jan 20 • 12

mmnga/DeepSeek-R1-Distill-Llama-70B-gguf

Updated Jan 21 • 214

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q4_K_S-GGUF

Text Generation • Updated Jan 20 • 196

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q5_0-GGUF

Text Generation • Updated Jan 20 • 31