Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
openchat-3.6-8b-20240522-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
748b743
openchat-3.6-8b-20240522-GGUF
1 contributor
History:
7 commits
MaziyarPanahi
7b16c357814294c2ebb89dfae9b2570d811dcd5d4f842a1bcc5f0a689601bf51
748b743
verified
3 months ago
.gitattributes
1.96 kB
7b16c357814294c2ebb89dfae9b2570d811dcd5d4f842a1bcc5f0a689601bf51
3 months ago
README.md
3.02 kB
7b16c357814294c2ebb89dfae9b2570d811dcd5d4f842a1bcc5f0a689601bf51
3 months ago
openchat-3.6-8b-20240522-GGUF_imatrix.dat
4.99 MB
LFS
7b16c357814294c2ebb89dfae9b2570d811dcd5d4f842a1bcc5f0a689601bf51
3 months ago
openchat-3.6-8b-20240522.Q5_K_M.gguf
5.73 GB
LFS
afd02e07a5ca54d01213791973a19acb99e5fe24ffa6c561ceb06e380fee5954
3 months ago
openchat-3.6-8b-20240522.Q5_K_S.gguf
5.6 GB
LFS
316ca199d3e833f8c1c83f5c95a6ab0963c2d0cf70aefd23f834ea8ab01e8af4
3 months ago
openchat-3.6-8b-20240522.Q6_K.gguf
6.6 GB
LFS
9fcc00dc114b2dba336277250d90e2ddeb2a8443ce568007015d00cc3917c9b9
3 months ago
openchat-3.6-8b-20240522.Q8_0.gguf
8.54 GB
LFS
16bf4e15f14ddcfa2ff96a846c8beafdb9b92c280f5e8ddb2226bb64f0535372
3 months ago
openchat-3.6-8b-20240522.fp16.gguf
16.1 GB
LFS
d19e58e7ce7d5360a452dcf98451b9a41cbfb521e59e48dc3910bc6b0a5072c1
3 months ago
