Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
Mistral-7B finetuned on a dataset of BTS fanfic at 32k context.
|
2 |
+
|
3 |
+
This model uses the alpaca format:
|
4 |
+
```
|
5 |
+
{"instruction": "An interaction between a user providing instructions, and an imaginative assistant providing responses.", "input": "...", "output": "..."}
|
6 |
+
```
|
7 |
+
Note RoPE scaling parameter **8.0**, with RoPE scaling type linear
|