Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
DeepSeek-R1-Distill-Llama-8B-GGUF
like
0
Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Use this model
refs/pr/1
DeepSeek-R1-Distill-Llama-8B-GGUF
1 contributor
History:
7 commits
MaziyarPanahi
003f28a15111c766700df3481647b05844485eb7fa56bbe43cd8d9191a381491
f66337d
verified
7 days ago
.gitattributes
Safe
1.98 kB
003f28a15111c766700df3481647b05844485eb7fa56bbe43cd8d9191a381491
7 days ago
DeepSeek-R1-Distill-Llama-8B-GGUF_imatrix.dat
4.99 MB
LFS
003f28a15111c766700df3481647b05844485eb7fa56bbe43cd8d9191a381491
7 days ago
DeepSeek-R1-Distill-Llama-8B.Q5_K_M.gguf
Safe
5.73 GB
LFS
8267c06fe7c69b6d6229dc423529ac44ddd36443a14046f9fc110e7050c3abd7
7 days ago
DeepSeek-R1-Distill-Llama-8B.Q5_K_S.gguf
Safe
5.6 GB
LFS
ee4a9f15e296adff39403bda4656ab0d6ebe9f616943a252f1c3659b39cc9442
7 days ago
DeepSeek-R1-Distill-Llama-8B.Q6_K.gguf
Safe
6.6 GB
LFS
73d83207952d3e2de8f7ebfa818db7ce84a8ef1575033c1e7af99ca90cae29a8
7 days ago
DeepSeek-R1-Distill-Llama-8B.Q8_0.gguf
Safe
8.54 GB
LFS
413efec509fcab04f087b27df3b9d2c085c3be3959ea37634b8310076844aba8
7 days ago
DeepSeek-R1-Distill-Llama-8B.fp16.gguf
Safe
16.1 GB
LFS
80b42052b4c132b3b284e99a89cb17674a75eedc403842d9cc96083e865b3065
7 days ago
README.md
Safe
3.04 kB
003f28a15111c766700df3481647b05844485eb7fa56bbe43cd8d9191a381491
7 days ago
