-
-
-
-
-
-
Inference Providers
Active filters:
fp8
neuralmagic/Qwen2-57B-A14B-Instruct-FP8
Text Generation
•
Updated
•
171
•
1
nm-testing/Qwen2-1.5B-Instruct-FP8-K-V
Text Generation
•
Updated
•
1.17k
nm-testing/Meta-Llama-3-8B-Instruct-FP8-K-V
Text Generation
•
Updated
•
24
neuralmagic/DeepSeek-Coder-V2-Lite-Instruct-FP8
Text Generation
•
Updated
•
6.25k
•
6
neuralmagic/DeepSeek-Coder-V2-Lite-Base-FP8
Text Generation
•
Updated
•
31
Rallio67/llama3-70b-exab-fp8
Text Generation
•
Updated
•
10
mgoin/Mistral-Nemo-Instruct-2407-FP8-Dynamic
Text Generation
•
Updated
•
158
mgoin/Mistral-Nemo-Instruct-2407-FP8-KV
Text Generation
•
Updated
•
9
obamaTeo/llama-finetune-8bit-wiki-252-ver2
Text Generation
•
Updated
•
7
FlorianJc/Mistral-Nemo-Instruct-2407-vllm-fp8
Text Generation
•
Updated
•
199
•
8
darthhexx/Meta-Llama-3-8B-Instruct-FP8
Text Generation
•
Updated
•
21
mgoin/Nemotron-4-340B-Instruct-FP8-Dynamic
Text Generation
•
Updated
•
10
neuralmagic/DeepSeek-Coder-V2-Base-FP8
Text Generation
•
Updated
•
14
neuralmagic/DeepSeek-Coder-V2-Instruct-FP8
Text Generation
•
Updated
•
1.19k
•
7
mgoin/Minitron-4B-Base-FP8
Text Generation
•
Updated
•
1.13k
•
3
mgoin/Minitron-8B-Base-FP8
Text Generation
•
Updated
•
19
•
3
nm-testing/Qwen2-0.5B-Instruct-FP8-SkipQKV
Text Generation
•
Updated
•
1.88k
neuralmagic/Meta-Llama-3.1-8B-Instruct-FP8-dynamic
Text Generation
•
Updated
•
7.57k
•
5
PrimeIntellect/Meta-Llama-3.1-8B-Instruct-FP8
Text Generation
•
Updated
•
52
neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8
Text Generation
•
Updated
•
2.66k
•
31
neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8-dynamic
Text Generation
•
Updated
•
174
•
14
darthhexx/Meta-Llama-3.1-8B-Instruct-FP8
Text Generation
•
Updated
•
230
mgoin/Nemotron-4-340B-Base-hf-FP8
Text Generation
•
Updated
•
13
•
2
mgoin/Nemotron-4-340B-Instruct-hf-FP8
Text Generation
•
Updated
•
36
•
3
FlorianJc/ghost-8b-beta-vllm-fp8
Text Generation
•
Updated
•
15
FlorianJc/Meta-Llama-3.1-8B-Instruct-vllm-fp8
Text Generation
•
Updated
•
127
iwaitu/llama-3.1-70b-chinese-chat-FP8
Text Generation
•
Updated
•
17
AuriAetherwiing/L3.1-8B-Celeste-V1.5-fp8-dynamic
Text Generation
•
Updated
•
13
AuriAetherwiing/Celeste-12B-V1.6-fp8-dynamic
Text Generation
•
Updated
•
13
AuriAetherwiing/magnum-72b-v1-fp8-dynamic
Text Generation
•
Updated
•
11