Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

8-bit precision

AutoTrain Compatible

text-generation-inference

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

8,894

Full-text search

Active filters: pruna-ai

PrunaAI/TheDrummer-Moistral-11B-v4-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 5

PrunaAI/TheDrummer-Moistral-11B-v4-QUANTO-float8bit-smashed

Updated Jul 19, 2024 • 5

PrunaAI/TheDrummer-Moistral-11B-v4-QUANTO-int4bit-smashed

Updated Jul 19, 2024 • 5

PrunaAI/icefog72-IceLatteRP-7b-bnb-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 68

PrunaAI/TheDrummer-Moistral-11B-v4-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 65

PrunaAI/icefog72-IceLatteRP-7b-bnb-8bit-smashed

Text Generation • Updated Jul 16, 2024 • 65

PrunaAI/icefog72-IceLatteRP-7b-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 5

PrunaAI/icefog72-IceLatteRP-7b-QUANTO-float8bit-smashed

Updated Jul 19, 2024 • 5

PrunaAI/icefog72-IceLatteRP-7b-QUANTO-int4bit-smashed

Updated Jul 19, 2024 • 4

PrunaAI/icefog72-IceLatteRP-7b-QUANTO-int2bit-smashed

Updated Jul 19, 2024 • 5

PrunaAI/Orenguteng-Llama-3-8B-LexiFun-Uncensored-V1-bnb-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 65

PrunaAI/Orenguteng-Llama-3-8B-LexiFun-Uncensored-V1-bnb-8bit-smashed

Text Generation • Updated Jul 16, 2024 • 7

PrunaAI/Orenguteng-Llama-3-8B-LexiFun-Uncensored-V1-HQQ-1bit-smashed

Text Generation • Updated Jul 16, 2024 • 7

PrunaAI/Orenguteng-Llama-3-8B-LexiFun-Uncensored-V1-HQQ-2bit-smashed

Text Generation • Updated Jul 16, 2024 • 7

PrunaAI/microsoft-Phi-3-medium-4k-instruct-GGUF-smashed

Updated Jul 16, 2024 • 446

PrunaAI/Orenguteng-Llama-3-8B-LexiFun-Uncensored-V1-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 6

PrunaAI/Orenguteng-Llama-3-8B-LexiFun-Uncensored-V1-QUANTO-float8bit-smashed

Updated Jul 19, 2024 • 6

PrunaAI/Orenguteng-Llama-3-8B-LexiFun-Uncensored-V1-QUANTO-int4bit-smashed

Updated Jul 19, 2024 • 6

PrunaAI/Orenguteng-Llama-3-8B-LexiFun-Uncensored-V1-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 65

PrunaAI/zhengr-MixTAO-7Bx2-MoE-v8.1-bnb-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 66

PrunaAI/zhengr-MixTAO-7Bx2-MoE-v8.1-HQQ-2bit-smashed

Text Generation • Updated Jul 16, 2024 • 9

PrunaAI/zhengr-MixTAO-7Bx2-MoE-v8.1-HQQ-1bit-smashed

Text Generation • Updated Jul 16, 2024 • 7

PrunaAI/prometheus-eval-prometheus-7b-v2.0-bnb-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 67

PrunaAI/prometheus-eval-prometheus-7b-v2.0-bnb-8bit-smashed

Text Generation • Updated Jul 16, 2024 • 68

PrunaAI/prometheus-eval-prometheus-7b-v2.0-HQQ-1bit-smashed

Text Generation • Updated Jul 16, 2024 • 10

PrunaAI/prometheus-eval-prometheus-7b-v2.0-HQQ-2bit-smashed

Text Generation • Updated Jul 16, 2024 • 9

PrunaAI/zhengr-MixTAO-7Bx2-MoE-v8.1-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 67

PrunaAI/prometheus-eval-prometheus-7b-v2.0-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 71

PrunaAI/rombodawg-test_dataset_Codellama-3-8B-QUANTO-float8bit-smashed

Updated Jul 19, 2024 • 6

PrunaAI/rombodawg-test_dataset_Codellama-3-8B-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 5