jspr commited on
Commit
3700967
·
verified ·
1 Parent(s): a1a16a3

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -0
README.md ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ Mistral-7B finetuned on a dataset of BTS fanfic at 32k context.
2
+
3
+ This model uses the alpaca format:
4
+ ```
5
+ {"instruction": "An interaction between a user providing instructions, and an imaginative assistant providing responses.", "input": "...", "output": "..."}
6
+ ```
7
+ Note RoPE scaling parameter **8.0**, with RoPE scaling type linear