Calibration dataset
#4
by
AlphaGaO
- opened
In my bench, your exl2 quant consistently outperform bartowsky ones at same precision, would you share your calibration dataset and params?
@AlphaGaO
I'm sorry I didn't understand your point. We haven't had time to prepare the quantitative model of exl2 format.
There is community open source version, you can use the model https://huggingface.co/LoneStriker/YiXin-Distill-Qwen-72B-4.5bpw-h6-exl2 here.
In terms of calibration dataset, I think you can choose some open source data is the same.