Hugging Face's logo

roleplaiapp
/
Chocolatine-2-14B-Instruct-v2.0b2-i1-IQ3_M-GGUF

Text Generation
Transformers
GGUF
14b
IQ3_M
chocolatine
instruct
iq3
llama-cpp
v20b2
Inference Endpoints
imatrix
conversational
Model card Files Community

roleplaiapp/Chocolatine-2-14B-Instruct-v2.0b2-i1-IQ3_M-GGUF

Repo: roleplaiapp/Chocolatine-2-14B-Instruct-v2.0b2-i1-IQ3_M-GGUF Original Model: Chocolatine-2-14B-Instruct-v2.0b2-i1 Quantized File: Chocolatine-2-14B-Instruct-v2.0b2.i1-IQ3_M.gguf Quantization: GGUF Quantization Method: IQ3_M

Overview

This is a GGUF IQ3_M quantized version of Chocolatine-2-14B-Instruct-v2.0b2-i1

Quantization By

I often have idle GPUs while building/testing for the RP app, so I put them to use quantizing models. I hope the community finds these quantizations useful.

Andrew Webby @ RolePlai.

Downloads last month
10
GGUF
Model size
14.8B params
Architecture
qwen2
View all files
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.