Zheng Han

traphix's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in cognitivecomputations/DeepSeek-V3-AWQ 4 days ago

Is there any accuracy results comparing to original DeepSeek-V3？

#6 opened 4 days ago by

traphix

New activity in cognitivecomputations/DeepSeek-R1-AWQ 4 days ago

why "MLA is not supported with awq_marlin quantization. Disabling MLA." with 4090 * 32 (4 node / vllm 0.7.2)

3

#14 opened 4 days ago by

FightLLM

Is there any accuracy results comparing to original DeepSeek-R1？

#15 opened 4 days ago by

traphix

New activity in cognitivecomputations/DeepSeek-R1-AWQ 8 days ago

Has anyone evaluated the performance of the AWQ version of the model on benchmarks?

4

#8 opened 12 days ago by

liuqianchao

New activity in cognitivecomputations/DeepSeek-R1-AWQ 13 days ago

skips the thinking process

11

#5 opened 16 days ago by

muzizon

Deployment framework

27

#2 opened about 1 month ago by

xro7

New activity in cognitivecomputations/DeepSeek-V3-AWQ 13 days ago

vllm support a100

17

#2 opened about 1 month ago by

HuggingLianWang

New activity in neuralmagic/Qwen2.5-72B-quantized.w8a8 15 days ago

Any plans to quantize Qwen/Qwen2.5-72B-Instruct to w8a8？

#1 opened 15 days ago by

traphix

New activity in neuralmagic/DeepSeek-Coder-V2-Instruct-FP8 6 months ago

Can it run on A100/A800 with VLLM?

3

#1 opened 7 months ago by

Parkerlambert123

liked a model 6 months ago

neuralmagic/DeepSeek-Coder-V2-Instruct-FP8

Text Generation • Updated Jul 22, 2024 • 341 • 7

upvoted a collection 6 months ago

INT8 LLMs for vLLM

Collection

Accurate INT8 quantized models by Neural Magic, ready for use with vLLM! • 50 items • Updated Sep 26, 2024 • 15

New activity in neuralmagic/DeepSeek-Coder-V2-Instruct-FP8 6 months ago

Quantize DeepSeek-Coder-V2-Instruct to W8A8(INT8)?

#2 opened 6 months ago by

traphix