Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
neuralmagic
/
Qwen2.5-72B-quantized.w8a8
like
0
Follow
Neural Magic
340
Text Generation
Safetensors
English
qwen2
chat
neuralmagic
llmcompressor
conversational
8-bit precision
compressed-tensors
License:
apache-2.0
Model card
Files
Files and versions
Community
1
New discussion
New pull request
Resources
PR & discussions documentation
Code of Conduct
Hub documentation
All
Discussions
Pull requests
View closed (0)
Any plans to quantize Qwen/Qwen2.5-72B-Instruct to w8a8？
#1 opened 15 days ago by
traphix
traphix