Edit Models filters

Misc

8-bit precision

AutoTrain Compatible

Inference Endpoints

Misc with no match

text-generation-inference

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

8

Full-text search

Active filters: w8a8

zzzmahesh/Meta-Llama-3-8B-Instruct-quantized.w8a8

Text Generation • Updated Sep 7, 2024 • 6

NeoChen1024/Dolphin3.0-Llama3.1-8B-W8A8

Updated 14 days ago • 12

NeoChen1024/dolphin-2.9.3-mistral-7B-32k-W8A8

Updated 25 days ago • 10

neuralmagic/granite-3.1-8b-instruct-quantized.w8a8

Text Generation • Updated 6 days ago • 149

neuralmagic/granite-3.1-2b-instruct-quantized.w8a8

Text Generation • Updated 6 days ago • 180

neuralmagic/granite-3.1-2b-base-quantized.w8a8

Text Generation • Updated about 19 hours ago • 23

neuralmagic/granite-3.1-8b-base-quantized.w8a8

Text Generation • Updated about 19 hours ago • 9

NeoChen1024/Ministral-8B-Instruct-2410-W8A8

Updated 14 days ago • 4