Hugging Face's logo

Delta-Vector
/
Sol-Reaver-15B-Instruct

Safetensors
mistral
roleplay
instruct
creative_writing
story-writing
Model card Files
xet
Community
Delta-Vector commited on
Commit
df24a83
·
verified ·
1 Parent(s): 732b3c4

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +414 -0
README.md ADDED
@@ -0,0 +1,414 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ datasets:
3
+ - Delta-Vector/Hydrus-Instruct-SmolTalk-V2
4
+ - Delta-Vector/Hydrus-SonnetOrca-V2
5
+ - Delta-Vector/Hydrus-FeedSum-ShareGPT
6
+ - Delta-Vector/Hydrus-Tulu-Personas-Filtered-Sharegpt
7
+ - Delta-Vector/Hydrus-No_Robots-R1-Filtered
8
+ - Delta-Vector/Hydrus-Chat_error-Pure-Dove-sharegpt
9
+ - Delta-Vector/Hydrus-HelpSteer2
10
+ - Delta-Vector/Hydrus-R1-Thinking-Sharegpt
11
+ - Delta-Vector/Hydrus-Science-QA-sharegpt
12
+ - Delta-Vector/Hydrus-Claude-Instruct-2.7K
13
+ - Delta-Vector/Hydrus-Claude-Instruct-5K
14
+ - PocketDoc/Dans-Assistantmaxx-UnnaturalInstructions-GPT4
15
+ - PocketDoc/Dans-Toolmaxx-ShellCommands
16
+ - PocketDoc/Dans-MemoryCore-CoreCurriculum-Small
17
+ - PocketDoc/Dans-Logicmaxx-SAT-AP
18
+ - PocketDoc/Dans-Benchmaxx
19
+ - Nitral-AI/ARES-ShareGPT
20
+ - PocketDoc/Dans-Taskmaxx-TableGPT
21
+ - Delta-Vector/Ursa-Erebus-16K
22
+ - Delta-Vector/Ursa-Books-Light-Novels-V1
23
+ - NewEden/Orion-LIT
24
+ - Delta-Vector/Ursa-Asstr-V2-18k
25
+ - Delta-Vector/Ursa-Books-V2
26
+ - Delta-Vector/Ursa-Scribblehub-7k
27
+ - Delta-Vector/Ursa-Orion-EA-Comp-Filtered
28
+ - Delta-Vector/Ursa-HoneyFeed
29
+ - Delta-Vector/Ursa-Falling-through-the-world
30
+ base_model:
31
+ - NewEden/Sol-Reaver-15B-Pretrain
32
+ tags:
33
+ - roleplay
34
+ - instruct
35
+ - creative_writing
36
+ - story-writing
37
+ - mistral
38
+ ---
39
+ <!DOCTYPE html>
40
+ <html lang="en">
41
+ <head>
42
+ <meta charset="UTF-8">
43
+ <meta name="viewport" content="width=device-width, initial-scale=1.0">
44
+ <title>Sol-Reaver 15B</title>
45
+ <link href="https://fonts.googleapis.com/css2?family=Quicksand:wght@400;500;600&display=swap" rel="stylesheet">
46
+ <style>
47
+ body {
48
+ font-family: 'Quicksand', sans-serif;
49
+ background: linear-gradient(135deg, #ffeef8 0%, #fff0e6 50%, #f8e8ff 100%);
50
+ color: #8b4a6b;
51
+ margin: 0;
52
+ padding: 0;
53
+ font-size: 16px;
54
+ min-height: 100vh;
55
+ }
56
+ .container {
57
+ margin: 20px;
58
+ background: linear-gradient(145deg, rgba(255, 255, 255, 0.9), rgba(255, 245, 250, 0.95));
59
+ padding: 30px;
60
+ border-radius: 20px;
61
+ box-shadow: 0 8px 32px rgba(255, 182, 193, 0.3), 0 4px 16px rgba(255, 215, 0, 0.2);
62
+ border: 2px solid rgba(255, 182, 193, 0.4);
63
+ position: relative;
64
+ backdrop-filter: blur(10px);
65
+ }
66
+ .container::before {
67
+ content: '';
68
+ position: absolute;
69
+ top: 0;
70
+ left: 0;
71
+ right: 0;
72
+ bottom: 0;
73
+ background: linear-gradient(45deg, rgba(255, 192, 203, 0.1), rgba(255, 215, 0, 0.1), rgba(221, 160, 221, 0.1));
74
+ border-radius: 20px;
75
+ z-index: -1;
76
+ }
77
+ .header h1 {
78
+ font-size: 32px;
79
+ background: linear-gradient(45deg, #d63384, #fd7e14, #e91e63);
80
+ -webkit-background-clip: text;
81
+ -webkit-text-fill-color: transparent;
82
+ background-clip: text;
83
+ margin: 0 0 20px 0;
84
+ text-align: center;
85
+ font-weight: 600;
86
+ text-shadow: 0 2px 4px rgba(255, 182, 193, 0.3);
87
+ }
88
+ .section {
89
+ margin-top: 30px;
90
+ }
91
+ .section h2 {
92
+ font-size: 24px;
93
+ background: linear-gradient(45deg, #d63384, #fd7e14);
94
+ -webkit-background-clip: text;
95
+ -webkit-text-fill-color: transparent;
96
+ background-clip: text;
97
+ text-align: center;
98
+ font-weight: 600;
99
+ margin-bottom: 20px;
100
+ }
101
+ .info p {
102
+ color: #8b4a6b;
103
+ line-height: 1.8;
104
+ font-size: 16px;
105
+ }
106
+ .info img {
107
+ width: 85%;
108
+ border-radius: 15px;
109
+ margin: 0 auto 15px;
110
+ display: block;
111
+ box-shadow: 0 8px 25px rgba(255, 182, 193, 0.4);
112
+ border: 2px solid rgba(255, 192, 203, 0.5);
113
+ }
114
+ a {
115
+ color: #d63384;
116
+ text-decoration: none;
117
+ transition: all 0.3s ease;
118
+ font-weight: 500;
119
+ }
120
+ a:hover {
121
+ color: #fd7e14;
122
+ text-shadow: 0 0 8px rgba(255, 215, 0, 0.6);
123
+ }
124
+ .button {
125
+ display: inline-block;
126
+ background: linear-gradient(45deg, #ffb6c1, #ffd700);
127
+ color: #8b4a6b;
128
+ padding: 12px 24px;
129
+ border-radius: 25px;
130
+ cursor: pointer;
131
+ text-decoration: none;
132
+ transition: all 0.3s ease;
133
+ border: 1px solid rgba(255, 182, 193, 0.5);
134
+ font-weight: 500;
135
+ }
136
+ .button:hover {
137
+ background: linear-gradient(45deg, #ff91a4, #ffed4e);
138
+ box-shadow: 0 4px 15px rgba(255, 182, 193, 0.6);
139
+ transform: translateY(-2px);
140
+ }
141
+ pre {
142
+ background: linear-gradient(135deg, rgba(255, 240, 245, 0.8), rgba(255, 248, 220, 0.8));
143
+ padding: 20px;
144
+ border-radius: 12px;
145
+ overflow-x: auto;
146
+ border: 1px solid rgba(255, 182, 193, 0.3);
147
+ box-shadow: inset 0 2px 4px rgba(255, 182, 193, 0.2);
148
+ }
149
+ code {
150
+ font-family: 'Courier New', monospace;
151
+ color: #8b4a6b;
152
+ }
153
+ .info-card {
154
+ background: linear-gradient(145deg, rgba(255, 240, 245, 0.9), rgba(255, 248, 220, 0.9));
155
+ border: 2px solid rgba(255, 182, 193, 0.4);
156
+ border-radius: 15px;
157
+ overflow: hidden;
158
+ box-shadow: 0 4px 20px rgba(255, 182, 193, 0.3);
159
+ }
160
+ .info-header {
161
+ background: linear-gradient(135deg, rgba(255, 192, 203, 0.3), rgba(255, 215, 0, 0.2));
162
+ padding: 25px;
163
+ border-bottom: 1px solid rgba(255, 182, 193, 0.3);
164
+ }
165
+ .info-header h3 {
166
+ background: linear-gradient(45deg, #d63384, #fd7e14);
167
+ -webkit-background-clip: text;
168
+ -webkit-text-fill-color: transparent;
169
+ background-clip: text;
170
+ margin: 0 0 15px 0;
171
+ font-size: 22px;
172
+ text-align: center;
173
+ font-weight: 600;
174
+ }
175
+ .model-tags {
176
+ display: flex;
177
+ gap: 10px;
178
+ flex-wrap: wrap;
179
+ justify-content: center;
180
+ }
181
+ .model-tag {
182
+ background: linear-gradient(45deg, rgba(255, 182, 193, 0.4), rgba(255, 215, 0, 0.3));
183
+ color: #8b4a6b;
184
+ padding: 8px 16px;
185
+ border-radius: 20px;
186
+ font-size: 13px;
187
+ border: 1px solid rgba(255, 182, 193, 0.5);
188
+ font-weight: 500;
189
+ box-shadow: 0 2px 8px rgba(255, 182, 193, 0.2);
190
+ }
191
+ .model-composition {
192
+ padding: 25px;
193
+ border-bottom: 1px solid rgba(255, 182, 193, 0.3);
194
+ }
195
+ .model-composition h4 {
196
+ background: linear-gradient(45deg, #d63384, #fd7e14);
197
+ -webkit-background-clip: text;
198
+ -webkit-text-fill-color: transparent;
199
+ background-clip: text;
200
+ margin: 0 0 20px 0;
201
+ font-size: 18px;
202
+ text-align: center;
203
+ font-weight: 600;
204
+ }
205
+ .composition-list {
206
+ list-style: none;
207
+ padding: 0;
208
+ margin: 0;
209
+ display: grid;
210
+ gap: 15px;
211
+ }
212
+ .composition-list li {
213
+ color: #8b4a6b;
214
+ display: flex;
215
+ align-items: baseline;
216
+ gap: 12px;
217
+ padding: 10px;
218
+ background: rgba(255, 240, 245, 0.5);
219
+ border-radius: 8px;
220
+ border-left: 4px solid #ffb6c1;
221
+ }
222
+ .model-component {
223
+ font-weight: 600;
224
+ min-width: 120px;
225
+ }
226
+ .model-description {
227
+ padding: 25px;
228
+ background: linear-gradient(135deg, rgba(255, 255, 255, 0.7), rgba(255, 240, 245, 0.8));
229
+ }
230
+ .metrics-section {
231
+ margin-bottom: 30px;
232
+ }
233
+ .metrics-section details {
234
+ background: linear-gradient(145deg, rgba(255, 240, 245, 0.9), rgba(255, 248, 220, 0.9));
235
+ border: 2px solid rgba(255, 182, 193, 0.4);
236
+ border-radius: 12px;
237
+ padding: 20px;
238
+ margin-bottom: 20px;
239
+ box-shadow: 0 4px 15px rgba(255, 182, 193, 0.2);
240
+ }
241
+ .metrics-section summary {
242
+ background: linear-gradient(45deg, #d63384, #fd7e14);
243
+ -webkit-background-clip: text;
244
+ -webkit-text-fill-color: transparent;
245
+ background-clip: text;
246
+ font-size: 18px;
247
+ cursor: pointer;
248
+ outline: none;
249
+ padding: 8px 0;
250
+ text-align: center;
251
+ font-weight: 600;
252
+ transition: all 0.3s ease;
253
+ }
254
+ .metrics-section summary:hover {
255
+ text-shadow: 0 0 8px rgba(255, 215, 0, 0.6);
256
+ }
257
+ .creator-section {
258
+ margin: 20px 0;
259
+ text-align: center;
260
+ }
261
+ .creator-badge {
262
+ display: inline-flex;
263
+ align-items: center;
264
+ background: linear-gradient(145deg, rgba(255, 240, 245, 0.9), rgba(255, 248, 220, 0.9));
265
+ border: 2px solid rgba(255, 182, 193, 0.4);
266
+ border-radius: 25px;
267
+ padding: 15px 20px;
268
+ box-shadow: 0 4px 15px rgba(255, 182, 193, 0.3);
269
+ }
270
+ .creator-label {
271
+ color: #8b4a6b;
272
+ font-size: 14px;
273
+ margin-right: 10px;
274
+ font-weight: 500;
275
+ }
276
+ .creator-link {
277
+ display: flex;
278
+ align-items: center;
279
+ gap: 8px;
280
+ color: #d63384;
281
+ text-decoration: none;
282
+ transition: all 0.3s ease;
283
+ }
284
+ .creator-name {
285
+ font-weight: 600;
286
+ }
287
+ .creator-arrow {
288
+ font-size: 16px;
289
+ transition: transform 0.3s ease;
290
+ }
291
+ .creator-link:hover .creator-arrow {
292
+ transform: translateX(4px);
293
+ color: #fd7e14;
294
+ }
295
+ .creator-link:hover {
296
+ color: #fd7e14;
297
+ text-shadow: 0 0 8px rgba(255, 215, 0, 0.6);
298
+ }
299
+ .link-arrow {
300
+ display: inline-block;
301
+ transition: transform 0.3s ease;
302
+ }
303
+ a:hover .link-arrow {
304
+ transform: translateX(3px);
305
+ }
306
+ .axolotl-container {
307
+ display: flex;
308
+ text-align: center; /* This is correctly applied to center the image itself */
309
+ justify-content: center;
310
+ margin: 30px 0;
311
+ }
312
+ .axolotl-container img {
313
+ max-width: 300px;
314
+ border-radius: 15px;
315
+ box-shadow: 0 6px 20px rgba(255, 182, 193, 0.4);
316
+ border: 2px solid rgba(255, 192, 203, 0.5);
317
+ transition: transform 0.3s ease;
318
+ display: block; /* Make the image a block element */
319
+ margin: 0 auto; /* Center it horizontally within its parent */
320
+ }
321
+ .axolotl-container img:hover {
322
+ transform: scale(1.05);
323
+ }
324
+ </style>
325
+ </head>
326
+ <body>
327
+ <div class="container">
328
+ <div class="header">
329
+ <h1>Sol Reaver 15B</h1>
330
+ </div>
331
+ <div class="info">
332
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/66c26b6fb01b19d8c3c2467b/DYgyLUEaHAv9kTffBYH-F.jpeg" alt="Model banner">
333
+ <div style="text-align: center;">
334
+ <div class="creator-section">
335
+ <div class="creator-badge">
336
+ <span class="creator-label">Created by</span>
337
+ <a href="https://huggingface.co/Delta-Vector" target="_blank" class="creator-link">
338
+ <span class="creator-name">Delta-Vector</span>
339
+ <span class="creator-arrow">→</span>
340
+ </a>
341
+ </div>
342
+ </div>
343
+ <div class="model-info">
344
+ <h2>Model Information</h2>
345
+ <div class="info-card">
346
+ <div class="info-header">
347
+ <h3>Sol-Reaver-15B-Instruct</h3>
348
+ <div class="model-tags">
349
+ <span class="model-tag">15B parameters</span>
350
+ <span class="model-tag">Creative / Fresh Prose</span>
351
+ <span class="model-tag">Co-writing/Roleplay/Adventure Generalist</span>
352
+ </div>
353
+ </div>
354
+ <div class="model-description">
355
+ <p>The first in the line of a New series of Roleplay / Adventure / Co-writer Models - Finetuned ontop of Sol-Reaver-15B-Pretrain</p>
356
+ <p>This model has been trained on 200M tokens of high quality Instruct data, It's focus is to provide a base for further finetuning|Merging</p>
357
+ <p>It's goal is to have refreshing Prose, Creativity, Good Instruct following and the *Brains*.</p>
358
+ </div>
359
+ </div>
360
+ </div>
361
+ <div class="section">
362
+ <h2>Quantized Versions</h2>
363
+ <div class="info-card">
364
+ <div class="model-composition">
365
+ <h4>Available Downloads</h4>
366
+ <ul class="composition-list">
367
+ <li><span class="model-component"><a href="" target="_blank">GGUF Format</a></span>For use with LLama.cpp & Forks(Coming Soon!)</li>
368
+ <li><span class="model-component"><a href="" target="_blank">EXL2 Format</a></span>For use with TabbyAPI (Coming Soon!)</li>
369
+ <li><span class="model-component"><a href="" target="_blank">EXL3 Format</a></span>For use with TabbyAPI (Slower on Ampere))</li>
370
+ </ul>
371
+ </div>
372
+ </div>
373
+ </div>
374
+ <div class="section">
375
+ <h2>Prompting</h2>
376
+ <p>Model has been tuned with the ChatML formatting. A typical input would look like this:</p>
377
+ <pre><code>&lt;|im_start|&gt;user
378
+ Hi there!&lt;|im_end|&gt;
379
+ &lt;|im_start|&gt;assistant
380
+ Nice to meet you!&lt;|im_end|&gt;
381
+ &lt;|im_start|&gt;user
382
+ Can I ask a question?&lt;|im_end|&gt;
383
+ &lt;|im_start|&gt;assistant
384
+ </code></pre>
385
+ </div>
386
+ <div class="section">
387
+ <h2>Samplers</h2>
388
+ <p>For testing of this model, I used Temp=1, 0.1 Min-P.</p>
389
+ <div class="metrics-section">
390
+ <details>
391
+ <summary>See Axolotl Config</summary>
392
+ <pre><code>
393
+ https://wandb.ai/new-eden/Rae/artifacts/axolotl-config/config-7d4ecudg/v0/files/axolotl_config_avyx566_.yml
394
+ </code></pre>
395
+ </details>
396
+ </div>
397
+ </div>
398
+ <div class="section">
399
+ <h2>Training</h2>
400
+ <p>The training was done for 2 epoch using 8 x <a href="https://www.nvidia.com/en-us/data-center/h200/">H200s</a> GPUs graciously provided by <a href="https://huggingface.co/kalomaze">Kalomaze</a> for the fine-tuning of the model.</p>
401
+ <div class="axolotl-container">
402
+ <a href="https://github.com/OpenAccess-AI-Collective/axolotl" target="_blank">
403
+ <img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl">
404
+ </a>
405
+ </div>
406
+ </div>
407
+ <div class="section">
408
+ <h2>Credits</h2>
409
+ <p>Thank you to <a href="https://huggingface.co/lucyknada">Lucy Knada</a>, <a href="https://huggingface.co/Ateron">Ateron</a>, <a href="https://huggingface.co/AliCat2">Alicat</a>, <a href="https://huggingface.co/intervitens">Intervitens</a>, <a href="https://huggingface.co/cgato">Cgato</a>, <a href="https://huggingface.co/kubernetes-bad">Kubernetes Bad</a> and the rest of <a href="https://huggingface.co/anthracite-org">Anthracite</a>.</p>
410
+ </div>
411
+ </div>
412
+ </div>
413
+ </body>
414
+ </html>