Hugging Quants

Activity Feed

AI & ML interests

Optimised quants for high-throughput deployments! Compatible with Transformers, TGI & vLLM 🤗

Recent Activity

dvilasuero authored a paper about 2 months ago

Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation

reach-vb authored a paper 3 months ago

Lina-Speech: Gated Linear Attention is a Fast and Parameter-Efficient Learner for text-to-speech synthesis

alvarobartt updated a model 4 months ago

hugging-quants/gemma-2-9b-it-AWQ-INT4

View all activity

Organization Card

Community About org cards

Welcome to the home of exciting quantized models! We'd love to see increased adoption of powerful state-of-the-art open models, and quantization is a key component to make them work on more types of hardware.

Resources:

Llama 3.1 Quantized Models: Optimised Quants of Llama 3.1 for high-throughput deployments! Compatible with Transformers, TGI & VLLM 🤗.
Hugging Face Llama Recipes: A set of minimal recipes to get started with Llama 3.1.

Collections 3

models 19

datasets

None public yet

AI & ML interests

Recent Activity

Team members 12

Collections 3

models 19 Sort: Recently updated

datasets

models 19