GGUFs for Aqueducts 18B - https://huggingface.co/MarsupialAI/Aqueducts-18B

iMatrix generated with Kalomaze's groups_merged.txt

Downloads last month
118
GGUF
Model size
17.7B params
Architecture
llama
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for MarsupialAI/Aqueducts-18B_iMatrix_GGUF

Quantized
(26)
this model