metadata
base_model: TinyLlama/TinyLlama_v1.1
language: en
license: mit
Metrics
| PPL | arc_easy | arc_challenge | piqa | winogrande | hellaswag | mmlu | QA Avg |
|---|---|---|---|---|---|---|---|
| 2203.2 | 25.38 ± 0.89 | 22.35 ± 1.22 | 53.05 ± 1.16 | 49.80 ± 1.41 | 25.76 ± 0.44 | - | 35.27 |
Training method based on BitDistiller Paper
- License: mit
- Finetuned from: TinyLlama/TinyLlama_v1.1