WHChoi

AbdulaHassan's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

upvoted an article 15 days ago

view article

Article

What is test-time compute and how to scale it?

By and 1 other •

Feb 6

• 54

upvoted a collection 6 months ago

Llama 3.1 GPTQ, AWQ, and BNB Quants

Collection

Optimised Quants for high-throughput deployments! Compatible with Transformers, TGI & VLLM 🤗 • 9 items • Updated Sep 26, 2024 • 56

upvoted 3 collections 7 months ago

FP8

Collection

20 items • Updated Nov 3, 2024 • 1

FP8 LLMs for vLLM

Collection

Accurate FP8 quantized models by Neural Magic, ready for use with vLLM! • 44 items • Updated Oct 17, 2024 • 67

INT8 LLMs for vLLM

Collection

Accurate INT8 quantized models by Neural Magic, ready for use with vLLM! • 50 items • Updated Sep 26, 2024 • 15