RedHatAI
/

granite-3.1-2b-instruct-FP8-dynamic

Text Generation

compressed-tensors

Model card Files Files and versions

nm-research commited on Jan 16

Commit

492f5db

·

verified ·

1 Parent(s): b758978

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -170,7 +170,7 @@ evalplus.evaluate \
 | MUSR (Acc-Norm, 0-shot)           | 35.12                             | 35.12                                         |
 | MMLU-Pro (Acc, 5-shot)            | 26.87                             | 28.33                                        |
 | **Average Score**                 | **35.17**                         | **34.88**                                    |
-| **Recovery**                      | **100.00**                         | ****                                    |
 #### HumanEval pass@1 scores
 | Metric                                  | ibm-granite/granite-3.1-2b-instruct             | neuralmagic-ent/granite-3.1-2b-instruct-FP8-dynamic |

 | MUSR (Acc-Norm, 0-shot)           | 35.12                             | 35.12                                         |
 | MMLU-Pro (Acc, 5-shot)            | 26.87                             | 28.33                                        |
 | **Average Score**                 | **35.17**                         | **34.88**                                    |
+| **Recovery**                      | **100.00**                         | **99.16**                                    |
 #### HumanEval pass@1 scores
 | Metric                                  | ibm-granite/granite-3.1-2b-instruct             | neuralmagic-ent/granite-3.1-2b-instruct-FP8-dynamic |