Quantized from Qwen/Qwen2.5-7B-Instruct-1M down to 4 bits, GEMM

Downloads last month: 2

Safetensors

Model size

1.96B params

Tensor type

I32

BF16

FP16

Inference Providers NEW

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for graelo/Qwen2.5-7B-Instruct-1M-AWQ

Base model

Qwen/Qwen2.5-7B

Finetuned

Qwen/Qwen2.5-7B-Instruct-1M

Quantized

(31)

this model