| base_model: TinyLlama/TinyLlama_v1.1 | |
| language: en | |
| license: mit | |
| ## Metrics | |
| | PPL | arc_easy |arc_challenge| piqa | winogrande | hellaswag |mmlu|QA Avg| | |
| |----:|------------|-------------|------------|------------|------------|----|-----:| | |
| |22.39|36.11 ± 0.99|21.84 ± 1.21 |60.72 ± 1.14|51.38 ± 1.40|32.73 ± 0.47|- | 40.56| | |
| Training method based on [BitDistiller Paper](https://arxiv.org/abs/2402.10631) | |
| - **License:** mit | |
| - **Finetuned from:** TinyLlama/TinyLlama_v1.1 |