metadata
base_model: TinyLlama/TinyLlama_v1.1
language: en
license: mit
Metrics
| PPL | arc_easy | arc_challenge | piqa | winogrande | hellaswag | mmlu | QA Avg |
|---|---|---|---|---|---|---|---|
| 2242.81 ± 0.00 | 35.40 ± 0.98 | 21.67 ± 1.20 | 60.55 ± 1.14 | 51.93 ± 1.40 | 32.22 ± 0.47 | - | 40.36 |
Training method based on BitDistiller Paper
- License: mit
- Finetuned from: TinyLlama/TinyLlama_v1.1