AWQ Version of jinaai/reader-lm-1.5b: 4 bit, 128 groupsize
✅ Tested on vLLM

Safetensors

Model size

409M params

Tensor type

I32

FP16

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model authors have turned it off explicitly.

Model tree for adriabama06/reader-lm-1.5b-AWQ

Base model

Quantized

(11)

this model