Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

8-bit precision

AutoTrain Compatible

text-generation-inference

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

8,894

Full-text search

Active filters: pruna-ai

PrunaAI/BAAI-Aquila2-7B-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 8

PrunaAI/BAAI-Aquila2-7B-QUANTO-int4bit-smashed

Updated Jul 19, 2024 • 4

PrunaAI/BAAI-Aquila2-7B-QUANTO-int2bit-smashed

Updated Jul 19, 2024 • 9

PrunaAI/BAAI-Aquila2-7B-HQQ-1bit-smashed

Text Generation • Updated Jul 16, 2024 • 12

PrunaAI/BAAI-Aquila2-7B-HQQ-2bit-smashed

Text Generation • Updated Jul 16, 2024 • 16

PrunaAI/BAAI-Aquila2-7B-HQQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 11

PrunaAI/BAAI-Aquila2-7B-bnb-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 101

PrunaAI/BAAI-Aquila2-7B-bnb-8bit-smashed

Text Generation • Updated Jul 16, 2024 • 12

PrunaAI/OmnicromsBrain-NeuralStar_AlphaWriter_4x7b-GGUF-smashed

Updated Jul 16, 2024 • 31

PrunaAI/instruction-pretrain-InstructLM-1.3B-bnb-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 69

PrunaAI/instruction-pretrain-InstructLM-1.3B-QUANTO-float8bit-smashed

Updated Jul 19, 2024 • 7

PrunaAI/instruction-pretrain-InstructLM-1.3B-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 11

PrunaAI/instruction-pretrain-InstructLM-1.3B-QUANTO-int4bit-smashed

Updated Jul 19, 2024 • 8

PrunaAI/instruction-pretrain-InstructLM-1.3B-QUANTO-int2bit-smashed

Updated Jul 19, 2024 • 6

PrunaAI/instruction-pretrain-InstructLM-1.3B-HQQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 13

PrunaAI/instruction-pretrain-InstructLM-1.3B-HQQ-2bit-smashed

Text Generation • Updated Jul 16, 2024 • 7

PrunaAI/instruction-pretrain-InstructLM-1.3B-HQQ-1bit-smashed

Text Generation • Updated Jul 16, 2024 • 9

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-32k-v0.1-QUANTO-int4bit-smashed

Updated Jul 19, 2024 • 4

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-32k-v0.1-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 5

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-32k-v0.1-QUANTO-int2bit-smashed

Updated Jul 19, 2024 • 9

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-32k-v0.1-bnb-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 65

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-32k-v0.1-bnb-8bit-smashed

Text Generation • Updated Jul 16, 2024 • 7

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-32k-v0.1-HQQ-2bit-smashed

Text Generation • Updated Jul 16, 2024 • 7

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-32k-v0.1-HQQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 9

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-32k-v0.1-HQQ-1bit-smashed

Text Generation • Updated Jul 16, 2024 • 6

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-32k-v0.1-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 65

PrunaAI/numind-NuExtract-HQQ-2bit-smashed

Text Generation • Updated Jul 16, 2024 • 9

PrunaAI/numind-NuExtract-HQQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 9

PrunaAI/numind-NuExtract-QUANTO-int4bit-smashed

Updated Jul 19, 2024 • 5

PrunaAI/numind-NuExtract-QUANTO-int2bit-smashed

Updated Jul 19, 2024 • 5