-
-
-
-
-
-
Inference Providers
Active filters:
nncf
AIFunOver/stable-diffusion-3.5-large-turbo-openvino-8bit
Text-to-Image
•
Updated
•
24
•
2
hsuwill000/AbsoluteReality-openvino-8bit
Text-to-Image
•
Updated
•
5
•
1
echarlaix/distilgpt2-openvino-4bit
Text Generation
•
Updated
•
50
echarlaix/distilbert-base-uncased-distilled-squad-openvino-8bit
Question Answering
•
Updated
•
18
emmacall/Phi-3-mini-4k-instruct-openvino-4bit
Text Generation
•
Updated
•
10
riacheruvu/Qwen2-7B-Instruct-openvino-4bit
Text Generation
•
Updated
•
16
riacheruvu/Qwen2-7B-Instruct-openvino-8bit
Text Generation
•
Updated
•
16
fiorezhang/Qwen2-7B-Instruct-openvino-4bit
Text Generation
•
Updated
•
15
malcolmchan/Phi-3-mini-4k-instruct-openvino-8bit
Text Generation
•
Updated
•
16
emmacall/Phi-3-medium-4k-instruct-openvino-4bit
Text Generation
•
Updated
•
16
elucidator8918/Lynx-8B-Instruct-4bit
Text Generation
•
Updated
•
14
AlexKoff88/Phi-3-mini-4k-instruct-openvino-4bit
Text Generation
•
Updated
•
10
AlexKoff88/Phi-3-mini-4k-instruct-openvino-8bit
Text Generation
•
Updated
•
13
yujiepan/llama-2-tiny-3layers-random-openvino-8bit
Text Generation
•
Updated
•
15
yujiepan/mixtral-8xtiny-random-openvino-8bit
Text Generation
•
Updated
•
43
FM-1976/stablelm-zephyr-3b-openvino-4bit
riacheruvu/phi-2-openvino-8bit
Text Generation
•
Updated
•
13
chgk13/Qwen2-0.5B-openvino-8bit
Text Generation
•
Updated
•
17
AlexKoff88/TinyLlama-1.1B-Chat-v1.0-openvino-4bit
Updated
•
20
AlexKoff88/opt-125m-openvino-4bit
Text Generation
•
Updated
•
17
AlexKoff88/Phi-3.5-mini-instruct-openvino-fp16
Text Generation
•
Updated
•
18
AlexKoff88/Phi-3.5-mini-instruct-openvino-4bit
Text Generation
•
Updated
•
15
AlexKoff88/Phi-3.5-mini-instruct-openvino-8bit
Text Generation
•
Updated
•
11
AIFunOver/Phi-3.5-mini-instruct-openvino-fp16
Text Generation
•
Updated
•
12
AIFunOver/Phi-3.5-mini-instruct-openvino-4bit
Text Generation
•
Updated
•
15
AIFunOver/SmolLM2-1.7B-Instruct-openvino-8bit
Text Generation
•
Updated
•
13
AIFunOver/SmolLM2-1.7B-Instruct-openvino-fp16
Text Generation
•
Updated
•
13
AIFunOver/SmolLM2-1.7B-Instruct-openvino-4bit
Text Generation
•
Updated
•
21
AIFunOver/SmolLM2-360M-Instruct-openvino-8bit
Text Generation
•
Updated
•
11
AIFunOver/SmolLM2-360M-Instruct-openvino-fp16
Text Generation
•
Updated
•
23