Edit Models filters

Misc

Inference Endpoints

8-bit precision

AutoTrain Compatible

text-generation-inference

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

7,604

Full-text search

Active filters: pruna-ai

PrunaAI/openlm-research-open_llama_3b_v2-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 3

PrunaAI/VMware-open-llama-7b-v2-open-instruct-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 6

PrunaAI/openlm-research-open_llama_7b-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 2

PrunaAI/facebook-opt-6.7b-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 3

PrunaAI/facebook-opt-1.3b-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 3

PrunaAI/KoboldAI-OPT-6B-nerys-v2-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 5

PrunaAI/facebook-opt-2.7b-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 8

PrunaAI/VMware-open-llama-7b-v2-open-instruct-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 4

PrunaAI/VMware-open-llama-7b-open-instruct-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 2

PrunaAI/facebook-opt-6.7b-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 2

PrunaAI/openai-community-gpt2-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 4

PrunaAI/KoboldAI-OPT-6.7B-Erebus-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 3

PrunaAI/KoboldAI-OPT-6.7B-Nerybus-Mix-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 6

PrunaAI/facebook-opt-350m-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 3

PrunaAI/HuggingFaceM4-tiny-random-LlamaForCausalLM-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 4

PrunaAI/KoboldAI-OPT-2.7B-Erebus-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 2

PrunaAI/sshleifer-tiny-gpt2-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 5

PrunaAI/mistralai-Mistral-7B-v0.1-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 3

PrunaAI/HuggingFaceM4-tiny-random-LlamaForCausalLM-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 6

PrunaAI/sshleifer-tiny-gpt2-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 5

PrunaAI/openai-community-gpt2-large-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 3

PrunaAI/KoboldAI-OPT-6B-nerys-v2-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 4

PrunaAI/mistralai-Mistral-7B-Instruct-v0.2-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 9 • 1

PrunaAI/mistralai-Mistral-7B-Instruct-v0.1-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 5

PrunaAI/facebook-opt-2.7b-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 4

PrunaAI/KoboldAI-OPT-2.7B-Erebus-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 4

PrunaAI/openai-community-gpt2-medium-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 3

PrunaAI/tiiuae-falcon-rw-1b-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 2

PrunaAI/EleutherAI-gpt-neo-125m-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 4

PrunaAI/KoboldAI-OPT-6.7B-Nerybus-Mix-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 10