Model Description

This is a Medusa model for Mistral 7B Instruct v0.2. This is trained using the latest Medusa 2 commit.

Training:

Dataset used is the self distillation dataset from Mistral 7B Instruct v0.2, temperature 0.3 with output token of 2048.
It has been trained using axolotl fork as describe in Medusa 2 README.md

Inference:

To load the model please follow the instruction found in Github

Downloads last month: 7

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for EmbeddedLLM/Medusa2-Mistral-7B-Instruct-v0.2

Merges

1 model