Prompt Format: ChatML
This is an experimental which was heavily optimized for reasoning tasks and not meant for production-use.
GGUFs: https://huggingface.co/mradermacher/raspberry-3B-GGUF
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 15.40 |
| IFEval (0-Shot) | 31.54 |
| BBH (3-Shot) | 19.53 |
| MATH Lvl 5 (4-Shot) | 7.63 |
| GPQA (0-shot) | 3.69 |
| MuSR (0-shot) | 9.41 |
| MMLU-PRO (5-shot) | 20.60 |
- Downloads last month
- 69