Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
legraphista
/
aya-23-8B-GGUF
like
0
Text Generation
GGUF
23 languages
conversational
License:
cc-by-nc-4.0
Model card
Files
Files and versions
Community
Deploy
Use this model
aya-23-8B-GGUF
aya-23-8B-GGUF
This is GGUF quantized version of
CohereForAI/aya-23-8B
created using llama.cpp
74f33adf
Downloads last month
57
GGUF
Model size
8.03B params
Architecture
command-r
Hardware compatibility
Log In
to view the estimation
4-bit
Q4_K_S
4.83 GB
Q4_K
5.06 GB
Q4_K_M
5.06 GB
5-bit
Q5_K_S
5.67 GB
Q5_K
5.8 GB
Q5_K_M
5.8 GB
6-bit
Q6_K
6.6 GB
8-bit
Q8_0
8.54 GB
16-bit
BF16
16.1 GB
View +1 variant
Inference Providers
NEW
Text Generation
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
HF Inference deployability: The HF Inference API does not support text-generation models for gguf library.
Model tree for
legraphista/aya-23-8B-GGUF
Base model
CohereForAI/aya-23-8B
Quantized
(
17
)
this model
Collection including
legraphista/aya-23-8B-GGUF
aya-23
Collection
4 items
โข
Updated
Aug 5, 2024