Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

AutoTrain Compatible

Inference Endpoints

text-generation-inference

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

122

Full-text search

Active filters: aqlm

ISTA-DASLab/Qwen2-72B-AQLM-PV-1bit-1x16

Text Generation • Updated Jul 25, 2024 • 12

azhiboedova/Meta-Llama-3.1-8B-Instruct-AQLM-2Bit-1x16

Text Generation • Updated Aug 28, 2024 • 36 • 13

ISTA-DASLab/Meta-Llama-3.1-8B-AQLM-PV-1Bit-1x16-hf

Text Generation • Updated Aug 9, 2024 • 87

ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-1Bit-1x16-hf

Text Generation • Updated Aug 9, 2024 • 70

ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-2Bit-1x16-hf

Text Generation • Updated Aug 28, 2024 • 34 • 8

ISTA-DASLab/Meta-Llama-3.1-8B-AQLM-PV-2Bit-1x16-hf

Text Generation • Updated Aug 9, 2024 • 85 • 3

galqiwi/Meta-Llama-3.1-8B-AQLM-2x8g8-NO-TUNE

Updated Aug 8, 2024 • 4

ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-2Bit-2x8-hf

Text Generation • Updated Aug 9, 2024 • 143 • 2

ISTA-DASLab/Mistral-Nemo-Instruct-2407-AQLM-PV-2Bit-1x16-hf

Updated Aug 16, 2024 • 11 • 3

ISTA-DASLab/Meta-Llama-3.1-70B-AQLM-PV-2Bit-1x16

Text Generation • Updated Sep 14, 2024 • 21 • 17

ISTA-DASLab/Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16

Text Generation • Updated Sep 17, 2024 • 76 • 46

ISTA-DASLab/Llama-3.2-3B-AQLM-PV-2Bit-2x8

Text Generation • Updated Nov 8, 2024 • 884

ISTA-DASLab/Llama-3.2-1B-AQLM-PV-2Bit-2x8

Text Generation • Updated Nov 8, 2024 • 479

ISTA-DASLab/Llama-3.2-1B-Instruct-AQLM-PV-2Bit-2x8

Text Generation • Updated Nov 8, 2024 • 29

PrunaAI/ISTA-DASLab-Llama-3.2-3B-AQLM-PV-2Bit-2x8-bnb-smashed

Updated Nov 8, 2024 • 6

ISTA-DASLab/Llama-3.2-3B-Instruct-AQLM-PV-2Bit-2x8

Text Generation • Updated Nov 8, 2024 • 16

slobers/pik3

Text Generation • Updated Nov 14, 2024 • 48

sdyy/bb

Updated Dec 20, 2024 • 8

Devy1/CodeLlama-7b-hf-AQLM-2bit-rnd-1x15

Text Generation • Updated 7 days ago • 7

Devy1/CodeLlama-7b-hf-AQLM-3bit-rnd-2x12

Text Generation • Updated 7 days ago • 10

Devy1/CodeLlama-7b-hf-AQLM-4bit-rnd-2x15

Text Generation • Updated 7 days ago • 9

Devy1/CodeLlama-7b-hf-AQLM-8bit-rnd-4x15

Text Generation • Updated 7 days ago • 8

Devy1/DeepSeek-Coder-6.7b-base-AQLM-2bit-rnd-1x15

Text Generation • Updated 7 days ago • 12

Devy1/DeepSeek-Coder-6.7b-base-AQLM-3bit-rnd-2x12

Text Generation • Updated 7 days ago • 12

Devy1/DeepSeek-Coder-6.7b-base-AQLM-4bit-rnd-2x15

Text Generation • Updated 7 days ago • 8

Devy1/DeepSeek-Coder-6.7b-base-AQLM-8bit-rnd-4x15

Text Generation • Updated 7 days ago • 11

Devy1/CodeLlama-7b-hf-AQLM-2bit-code-1x15

Text Generation • Updated 7 days ago • 9

Devy1/CodeLlama-7b-hf-AQLM-2bit-code-finetuned-1x15

Text Generation • Updated 7 days ago • 6

Devy1/CodeLlama-7b-hf-AQLM-2bit-mixed-1x15

Text Generation • Updated 7 days ago • 10

Devy1/CodeLlama-7b-hf-AQLM-2bit-mixed-finetuned-1x15

Text Generation • Updated 7 days ago • 8