Update README.md
Browse files
README.md
CHANGED
@@ -24,7 +24,8 @@ datasets:
|
|
24 |
- **Out-of-scope:** Use in any manner that violates applicable laws or regulations (including trade compliance laws). Use in any other way that is prohibited by the Acceptable Use Policy and Llama 3.1 Community License.
|
25 |
- **Model Developers:** Red Hat (Neural Magic)
|
26 |
|
27 |
-
This model is a fine-tuned version of [RedHatAI/Sparse-Llama-3.1-8B-2of4](https://huggingface.co/RedHatAI/Sparse-Llama-3.1-8B-2of4) on the trl-lib/tldr dataset.
|
|
|
28 |
|
29 |
## Deployment
|
30 |
|
|
|
24 |
- **Out-of-scope:** Use in any manner that violates applicable laws or regulations (including trade compliance laws). Use in any other way that is prohibited by the Acceptable Use Policy and Llama 3.1 Community License.
|
25 |
- **Model Developers:** Red Hat (Neural Magic)
|
26 |
|
27 |
+
This model is a fine-tuned version of the 2:4 sparse model [RedHatAI/Sparse-Llama-3.1-8B-2of4](https://huggingface.co/RedHatAI/Sparse-Llama-3.1-8B-2of4) on the trl-lib/tldr dataset.
|
28 |
+
This sparse model obtains 0.366 BERTScore on the test set of trl-lib/tldr, the same result obtained by nm-testing/Llama-3.1-8B-tldr(https://huggingface.co/nm-testing/Llama-3.1-8B-tldr), a dense model fine-tuned on the same dataset.
|
29 |
|
30 |
## Deployment
|
31 |
|