Just a q8_0 and q4_0 version. If you need versions with other quantization parameters, please let me know
- Downloads last month
- 472
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API does not yet support model repos that contain custom code.