8.0 BPW EXL2 quant of https://huggingface.co/EVA-UNIT-01/EVA-Qwen2.5-1.5B-v0.0 8bit heads. Default measurement dataset.

Downloads last month
12
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for MarsupialAI/EVA-Qwen2.5-1.5B-v0.0_EXL2_8.0BPW_H8

Base model

Qwen/Qwen2.5-1.5B
Quantized
(46)
this model