bitnet-5B-v1

I redesigned mergekit so that I could merge the bitnet 3B model (unlike version v0, where I did merge via PyTorch).

In theory, this is compatible with quantization via llama.cpp , but tests are needed.

Safetensors

Model size

4.56B params

Tensor type

BF16

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

Model tree for Ttimofeyka/bitnet-5B-v1

Base model

Finetuned

(1)

this model