This repository contains the BitStack-Llama-3-8B model as presented in BitStack: Fine-Grained Size Control for Compressed Large Language Models in Variable Memory Environments.

Downloads last month: 6

Safetensors

Model size

15.7B params

Tensor type

FP16

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.