Model Details

kaitchup/Mayonnaise-4in1-02 quantized to 4-bit with AutoAWQ.

The original model was created using a recipe detailed in this article: The Mayonnaise: Rank First on the Open LLM Leaderboard with TIES-Merging

Model Description

Downloads last month
78
Safetensors
Model size
1.2B params
Tensor type
I32
·
FP16
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Collection including kaitchup/Mayonnaise-4in1-02-awq-4bit