metadata
base_model: TinyLlama/TinyLlama_v1.1
language: en
license: mit
Metrics
| PPL | arc_easy | arc_challenge | piqa | winogrande | hellaswag | mmlu | QA Avg |
|---|---|---|---|---|---|---|---|
| 17899.79 | 26.26 ± 0.90 | 22.01 ± 1.21 | 52.01 ± 1.17 | 51.22 ± 1.40 | 25.96 ± 0.44 | - | 35.49 |
Training method based on BitDistiller Paper
- License: mit
- Finetuned from: TinyLlama/TinyLlama_v1.1