houghtob123
/

Falcon3-MoE-2x7B-Instruct-Q4_0

Inference Endpoints

Model card Files Files and versions Community

YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

A Q4_0 quant using the newest Llama.cpp (1/9/2025).

base_model: - ehristoforu/Falcon3-MoE-2x7B-Insruct

Downloads last month: 43

GGUF

Model size

13.4B params

Architecture

llama

4-bit

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model has no library tag.