Edit Models filters

Apps

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

45

Full-text search

Active filters: deepsparse

RedHatAI/SOLAR-10.7B-Instruct-v1.0-pruned50-quant-ds

Text Generation • Updated Dec 20, 2023 • 2 • 5

RedHatAI/CLIP-ViT-B-32-256x256-DataComp-s34B-b86K-quant-ds

Zero-Shot Classification • Updated Jan 12, 2024 • 8

RedHatAI/Nous-Hermes-llama-2-7b-pruned50-quant-ds

Text Generation • Updated Dec 20, 2023

RedHatAI/Llama2-7b-chat-pruned50-quant-ds

Text Generation • Updated Jan 10, 2024 • 9

RedHatAI/CLIP-ViT-B-32-256x256-DataComp-s34B-b86K-ds

Zero-Shot Classification • Updated Dec 20, 2023

RedHatAI/Nous-Hermes-2-SOLAR-10.7B-pruned50-quant-ds

Text Generation • Updated Jan 10, 2024 • 7

RedHatAI/Llama-2-7b-ultrachat200k-pruned_50-quantized-deepsparse

Text Generation • Updated May 7, 2024 • 4

RedHatAI/Llama-2-7b-ultrachat200k-pruned_70-quantized-deepsparse

Text Generation • Updated May 15, 2024 • 6

RedHatAI/Llama-2-7b-evol-code-alpaca-pruned_50-quantized-deepsparse

Text Generation • Updated May 15, 2024 • 1

RedHatAI/Llama-2-7b-evol-code-alpaca-pruned_70-quantized-deepsparse

Text Generation • Updated May 15, 2024 • 5

RedHatAI/Llama-2-7b-dolphin-open_platypus-pruned_50-quantized-deepsparse

Text Generation • Updated May 16, 2024 • 5

RedHatAI/Llama-2-7b-dolphin-open_platypus-pruned_70-quantized-deepsparse

Text Generation • Updated May 16, 2024 • 2 • 1

mgoin/Meta-Llama-3-8B-Instruct-pruned50-quant-ds

Text Generation • Updated Jun 28, 2024

nm-testing/mobilenet_v1-1.0_pytorch_sparseml_imagenet_pruned-moderate

Updated Nov 5, 2024

nm-testing/yolov8-m_pytorch_ultralytics_voc_pruned80_quant-none

Updated Nov 5, 2024