-
-
-
-
-
-
Inference Providers
Active filters:
fp8
FlorianJc/Llama3-ChatQA-1.5-8B-vllm-fp8
Text Generation
•
Updated
•
16
TechxGenus/Codestral-22B-v0.1-FP8
Text Generation
•
Updated
•
80
Model-SafeTensors/Meta-Llama-3-70B-FP8-Dynamic
Text Generation
•
Updated
•
39
Model-SafeTensors/Qwen-Qwen2-72B-FP8-Dynamic
Text Generation
•
Updated
•
34
nm-testing/Qwen2-1.5B-Instruct-FP8-KV
Text Generation
•
Updated
•
8
neuralmagic/Meta-Llama-3-70B-Instruct-FP8-KV
Text Generation
•
Updated
•
950
•
2
neuralmagic/Mistral-7B-Instruct-v0.3-FP8
Text Generation
•
Updated
•
431
•
2
neuralmagic/Llama-2-7b-chat-hf-FP8
Text Generation
•
Updated
•
349
Rallio67/llama-3-70B-actions-FP8
Text Generation
•
Updated
•
12
nm-testing/gemma-2-27b-it-FP8
Text Generation
•
Updated
•
61
•
3
nerdylive/Meta-Llama-3-8B-Instruct-FP8
Text Generation
•
Updated
•
9
nm-testing/Qwen2-57B-A14B-Instruct-FP8-KV
Text Generation
•
Updated
•
9
nm-testing/dbrx-instruct-FP8
Text Generation
•
Updated
•
10
FlorianJc/google-gemma-2-9b-it-vllm-fp8
Text Generation
•
Updated
•
131
•
1
tranhoangnguyen03/Gemma-2-9B-It-SPPO-Iter3_Q8
Text Generation
•
Updated
•
14
Model-SafeTensors/mistralai-Mixtral-8x7B-v0.1
Text Generation
•
Updated
•
9
Model-SafeTensors/mistralai-Mixtral-8x22B
Text Generation
•
Updated
•
8
FlorianJc/Llama3-ChatQA-1.5-8B-v2-vllm-fp8
Text Generation
•
Updated
•
10
FlorianJc/MegaBeam-Mistral-7B-300k-vllm-fp8
Text Generation
•
Updated
•
106
darthhexx/Phi-3-medium-128k-instruct-fp8
Text Generation
•
Updated
•
32
nm-testing/Llama-2-70b-chat-hf-FP8
Text Generation
•
Updated
•
620
muhtasham/TowerInstruct-7B-v0.1-FP8
Text Generation
•
Updated
•
10
Mohamad-Jaallouk/Meta-Llama-3-8B-FP8-Dynamic
Text Generation
•
Updated
•
6
raja-nectar/Lumimaid-70B-fp8
Text Generation
•
Updated
•
7
raja-nectar/Lumimaid-70B-FP8-OAS
Text Generation
•
Updated
•
6
Ksgk-fy/maria-v2-fp8-dynamic
Text Generation
•
Updated
Ksgk-fy/maria-v2-fp8-static
Text Generation
•
Updated
•
6
Ksgk-fy/maria_v113-fp8-dynamic
Text Generation
•
Updated
Ksgk-fy/maria_v114-fp8-dynamic
Text Generation
•
Updated
•
6
Ksgk-fy/maria_v115-fp8-dynamic
Text Generation
•
Updated
•
6