Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference Providers
Select all
Nebius AI Studio
Together AI
Hyperbolic
SambaNova
fal
Replicate
Novita
Cerebras
Fireworks
HF Inference API
Misc
Reset Misc
arxiv:
2309.05516
4-bit precision
custom_code
Inference Endpoints
AutoTrain Compatible
text-generation-inference
Misc with no match
Eval Results
Merge
8-bit precision
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
115
Full-text search
Edit filters
Sort: Trending
Active filters:
2309.05516
Clear all
OPEA/Mistral-Small-3.1-24B-Instruct-2503-int4-AutoRound-awq-sym
Updated
4 days ago
•
2.18k
•
4
OPEA/Mistral-Small-3.1-24B-Instruct-2503-int4-AutoRound-gptq-sym
Updated
4 days ago
•
109
•
2
Intel/Qwen2-7B-int4-inc
Text Generation
•
Updated
Oct 24, 2024
•
85
•
6
OPEA/llava-v1.5-7b-int4-sym-inc
Updated
Dec 24, 2024
•
21
•
1
OPEA/QwQ-32B-Preview-int4-sym-mixed-awq-inc
Updated
Dec 23, 2024
•
24
•
1
OPEA/SmolVLM-Instruct-int4-sym-inc
Updated
Jan 13
•
28
•
2
OPEA/llama-joycaption-alpha-two-hf-llava-int4-sym-inc
Updated
Jan 4
•
458
•
2
OPEA/Qwen2-VL-72B-Instruct-int2-sym-inc
Updated
Dec 23, 2024
•
22
•
4
OPEA/Meta-Llama-3.1-405B-Instruct-int4-sym-inc
Updated
Dec 23, 2024
•
12
•
1
OPEA/deepseek-vl2-int4-sym-gptq-inc
Updated
Jan 6
•
354
•
5
OPEA/DeepSeek-V2.5-1210-int4-sym-inc
Updated
Jan 6
•
44
•
8
OPEA/DeepSeek-V3-int4-sym-gptq-inc
Updated
Feb 12
•
721
•
17
OPEA/MiniMax-Text-01-int4-sym-inc-preview
Updated
Jan 20
•
15
•
1
OPEA/DeepSeek-V3-int4-sym-gguf-q4-0-inc
Updated
Feb 12
•
552
•
3
OPEA/DeepSeek-R1-int4-sym-gguf-q4-0-inc
Updated
12 days ago
•
414
•
14
OPEA/DeepSeek-R1-int2-mixed-sym-inc
Updated
12 days ago
•
258
•
5
OPEA/DeepSeek-R1-Distill-Qwen-32B-int4-gptq-sym-inc
Updated
23 days ago
•
91
•
1
OPEA/DeepSeek-R1-Distill-Llama-70B-int4-gptq-sym-inc
Updated
20 days ago
•
110
•
1
OPEA/QwQ-32B-int4-AutoRound-gptq-sym
Updated
3 days ago
•
6.07k
•
3
OPEA/DeepSeek-R1-int4-AutoRound-awq-asym
Updated
4 days ago
•
28
•
1
OPEA/DeepSeek-R1-w4afp8-gptq-sym-inc
Updated
about 7 hours ago
•
1
Intel/neural-chat-7b-v3-1-int4-inc
Text Generation
•
Updated
Aug 26, 2024
•
47
•
2
Intel/neural-chat-7b-v3-3-int4-inc
Text Generation
•
Updated
Aug 26, 2024
•
13
•
3
Intel/Mistral-7B-v0.1-int4-inc
Text Generation
•
Updated
May 31, 2024
•
131
•
4
Intel/falcon-7b-int4-inc
Text Generation
•
Updated
Aug 26, 2024
•
22
Intel/chatglm2-6b-int4-inc
Updated
Jul 4, 2024
Intel/Qwen1.5-0.5B-Chat-int4-inc
Updated
Jul 4, 2024
Intel/Phi-3-mini-4k-instruct-int4-inc
Updated
Jul 4, 2024
•
4
Intel/chatglm3-6b-int4-inc
Updated
Jul 4, 2024
Intel/Baichuan2-7B-Chat-int4-inc
Updated
Jul 4, 2024
Previous
1
2
3
4
Next