Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Carbon Emissions

Misc with no match

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Models

150

Full-text search

Active filters: q4_k_m

afrideva/dolphin-2_6-phi-2_oasst2_chatML_V2-GGUF

Text Generation • Updated Jan 19, 2024 • 78 • 2

afrideva/TinyLlama-haiku-dpo-v.0.1-GGUF

Text Generation • Updated Jan 19, 2024 • 19

afrideva/tinyllama-python-GGUF

Text Generation • Updated Jan 20, 2024 • 110

afrideva/phi-2-psy-GGUF

Text Generation • Updated Jan 20, 2024 • 27 • 6

afrideva/beecoder-220M-python-GGUF

Text Generation • Updated Jan 20, 2024 • 158

afrideva/smol_llama-220M-openhermes-GGUF

Text Generation • Updated Jan 20, 2024 • 90

afrideva/TinyLlama-3T-1.1bee-GGUF

Text Generation • Updated Jan 20, 2024 • 148 • 1

afrideva/smol_llama-220M-bees-internal-GGUF

Text Generation • Updated Jan 20, 2024 • 106

afrideva/smol_llama-220M-open_instruct-GGUF

Text Generation • Updated Jan 20, 2024 • 34

afrideva/zephyr-220m-sft-full-GGUF

Text Generation • Updated Jan 20, 2024 • 27

afrideva/zephyr-220m-dpo-full-GGUF

Text Generation • Updated Jan 20, 2024 • 33

afrideva/stablelm-2-1_6b-GGUF

Text Generation • Updated Jan 22, 2024 • 276 • 3

afrideva/stablelm-2-zephyr-1_6b-GGUF

Text Generation • Updated Jan 22, 2024 • 59 • 3

ayoubkirouane/Mistral-Depth-UP-Scaled-9B-AlpacaInstruct-gguf

Text Generation • Updated Jan 24, 2024 • 64

afrideva/LocutusqueXFelladrin-TinyMistral248M-Instruct_oasst2_chatML_V1_DPO_V3-GGUF

Text Generation • Updated Jan 27, 2024 • 20

afrideva/tau-0.5B-GGUF

Text Generation • Updated Mar 25, 2024 • 89

afrideva/tau-0.5B-instruct-GGUF

Text Generation • Updated Mar 25, 2024 • 38

afrideva/NeuralReyna-Mini-1.8B-v0.3-GGUF

Text Generation • Updated Mar 25, 2024 • 56 • 1

leafspark/wavecoder-ds-6.7b-GGUF

Text Generation • Updated Apr 17, 2024 • 111 • 1

afrideva/gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2-GGUF

Text Generation • Updated Apr 17, 2024 • 707 • 6

afrideva/Bioinspired-Phi-3-mini-4k-GGUF

Text Generation • Updated May 3, 2024 • 130

afrideva/gemma-1.1-2b-it_orpo_traslate_en_es_V1-GGUF

Text Generation • Updated May 10, 2024 • 146

jhangmez/CHATPRG-v0.2.1-Meta-Llama-3.1-8B-bnb-4bit-q4_k_m

Text Generation • Updated Jul 29, 2024 • 123 • 1

jhangmez/CHATPRG-v1.2-Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Aug 31, 2024 • 73 • 1

jhangmez/CHATPRG-v1.2-Phi-3.5-mini-instruct-GGUF

Text2Text Generation • Updated Sep 1, 2024 • 371 • 1

ussipan/SipanGPT-0.1-Llama-3.2-1B-GGUF

Text2Text Generation • Updated Oct 19, 2024 • 216 • • 1

ussipan/SipanGPT-0.2-Llama-3.2-1B-GGUF

Text2Text Generation • Updated Oct 19, 2024 • 146

ussipan/SipanGPT-0.3-Llama-3.2-1B-GGUF

Text2Text Generation • Updated Dec 23, 2024 • 85 • 1

shreyasmeher/ConflLlama

Text Classification • Updated about 20 hours ago • 123 • 1

AdvRahul/Dharma-DeepScaleR-1.5B-Preview-Q4_K_M

Text Generation • Updated 16 days ago • 14