StableLM-2-Zephyr-1.6B-GGUF

Original Model

stabilityai/stablelm-2-zephyr-1_6b

Run with Gaianet

Prompt template:

prompt template: llama-2-chat

Context size:

chat_ctx_size: 4096

Run with GaiaNet:

Downloads last month
66
GGUF
Model size
1.64B params
Architecture
stablelm

5-bit

Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for gaianet/stablelm-2-zephyr-1.6b-GGUF

Quantized
(14)
this model

Datasets used to train gaianet/stablelm-2-zephyr-1.6b-GGUF