Просто сделал квантизацию модели

Downloads last month
43
Safetensors
Model size
2.31B params
Tensor type
I32
·
FP16
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for andretisch/llava-saiga-8b-awq

Quantized
(1)
this model