metadata
license: llama3.2
datasets:
- CarrotAI/Magpie-Ko-Pro-AIR
- CarrotAI/Carrot
- CarrotAI/ko-instruction-dataset
language:
- ko
- en
base_model:
- meta-llama/Llama-3.2-3B-Instruct
pipeline_tag: text-generation
Score
| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | ||
|---|---|---|---|---|---|---|---|---|
| gsm8k | 3 | flexible-extract | 5 | exact_match | ↑ | 0.6179 | ± | 0.0134 |
| strict-match | 5 | exact_match | ↑ | 0.6171 | ± | 0.0134 |
| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | ||
|---|---|---|---|---|---|---|---|---|
| kobest_boolq | 1 | none | 5 | acc | ↑ | 0.7664 | ± | 0.0113 |
| none | 5 | f1 | ↑ | 0.7662 | ± | N/A | ||
| kobest_copa | 1 | none | 5 | acc | ↑ | 0.5620 | ± | 0.0157 |
| none | 5 | f1 | ↑ | 0.5612 | ± | N/A | ||
| kobest_hellaswag | 1 | none | 5 | acc | ↑ | 0.3840 | ± | 0.0218 |
| none | 5 | acc_norm | ↑ | 0.4900 | ± | 0.0224 | ||
| none | 5 | f1 | ↑ | 0.3807 | ± | N/A | ||
| kobest_sentineg | 1 | none | 5 | acc | ↑ | 0.5869 | ± | 0.0247 |
| none | 5 | f1 | ↑ | 0.5545 | ± | N/A | ||
| kobest_wic | 1 | none | 5 | acc | ↑ | 0.4952 | ± | 0.0141 |
| none | 5 | f1 | ↑ | 0.4000 | ± | N/A |
@article{Llama3.2RabbitKo3BInstruct,
title={CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct Card},
author={CarrotAI (L, GEUN)},
year={2024},
url = {https://huggingface.co/CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct}
}