Highly experimental, not for general consumption

The code needed to running this model, as well as the base model itself are not ready yet.

This is uploaded merely to help testing.

see https://github.com/ggerganov/llama.cpp/pull/8151

Downloads last month
35
GGUF
Model size
3.99B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

4-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for Green-Sky/TriLM_3.9B-GGUF

Quantized
(2)
this model