graelo
/

Qwen2.5-7B-Instruct-1M-AWQ

4-bit precision

Model card Files Files and versions Community

Qwen2.5-7B-Instruct-1M-AWQ / README.md

graelo's picture

Create README.md

b843c65 verified about 2 months ago

|

history blame contribute delete

187 Bytes

	---
	license: apache-2.0
	base_model:
	- Qwen/Qwen2.5-7B-Instruct-1M
	---
	Quantized from [Qwen/Qwen2.5-7B-Instruct-1M](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct-1M) down to 4 bits, GEMM