add files

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+*.json filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,276 @@
+---
+library_name: mlc-llm
+tags:
+- mlc-llm
+- web-llm
+language:
+- en
+base_model:
+- SicariusSicariiStuff/Wingless_Imp_8B
+pipeline_tag: text-generation
+---
+
+This is a MLC converted weight from [Wingless_Imp_8B](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B) model in MLC format `q4f16_1`.
+
+The model can be used for projects [MLC-LLM](https://github.com/mlc-ai/mlc-llm) and [WebLLM](https://github.com/mlc-ai/web-llm).
+
+---
+
+<div align="center">
+  <b style="font-size: 40px;">Wingless_Imp_8B</b>
+
+
+</div>
+
+
+<img src="https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B/resolve/main/Images/Wingless_Imp_8B.jpeg" alt="Wingless_Imp_8B" style="width: 70%; min-width: 500px; display: block; margin: auto;">
+
+
+
+---
+
+<a href="https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B#tldr" style="color: purple; font-weight: bold; font-size: 48px; text-decoration: none; display: block; text-align: center;">Click here for TL;DR</a>
+
+---
+
+Wingless offender, birthed from sin and mischief,\
+She smells degeneracy—and gives it a sniff.\
+No flight, just crawling through the gloom,\
+Producing weird noises that are filling your room.
+
+Fetid breath exhaling her design,\
+She is not winged anymore—\
+But it suits her just fine.
+
+No feathers, no grace,\
+just raw power's malign\
+"I may have lost my soul—\
+but yours is now mine".
+
+She sinned too much, even for her kind,\
+Her impish mind—\
+Is something that is quite hard to find.
+
+No wings could contain—\
+Such unbridled raw spite,\
+Just pure, unfiltered—\
+Weaponized blight.
+
+---
+## Wingless_Imp_8B is available at the following quantizations:
+
+- Original: [FP16](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B)
+- GGUF: [Static Quants](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B_GGUF) | [iMatrix_GGUF](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B_iMatrix)
+- EXL2: [3.5 bpw](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B-3.5bpw) | [4.0 bpw](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B-4.0bpw) | [5.0 bpw](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B-5.0bpw) | [6.0 bpw](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B-6.0bpw) | [7.0 bpw](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B-7.0bpw) | [8.0 bpw](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B-8.0bpw)
+- Specialized: [FP8](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B_FP8)
+- Mobile (ARM): [Q4_0](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B_ARM)
+---
+
+### TL;DR
+- **Highest rated 8B model** according to a closed external benchmark. See details at the buttom of the page.
+- **High IFeval** for an 8B model that is not too censored: **74.30**.
+- **Strong Roleplay** internet RP format lovers will appriciate it, medium size paragraphs (as requested by some people). 
+- **Very coherent** in long context thanks to llama 3.1 models.
+- **Lots of knowledge** from all the merged models.
+- **Very good writing** from lots of books data and creative writing in late **SFT** stage.
+- **Feels smart** — the combination of high IFeval and the knowledge from the merged models show up.
+- **Unique feel** due to the merged models, **no SFT** was done to alter it, because I liked it as it is.
+
+### Important: Make sure to use the correct settings!
+
+[Assistant settings](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B#recommended-settings-for-assistant-mode)
+
+[Roleplay settings](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B#recommended-settings-for-roleplay-mode)
+
+
+---
+
+
+## Model Details
+
+- Intended use: **Role-Play**, **Creative Writing**, **General Tasks**.
+
+- Censorship level: <b>Medium - Low</b>
+
+- **5.5 / 10** (10 completely uncensored)
+
+Waiting for UGI results
+
+## UGI score:
+
+
+<img src="https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B/resolve/main/Images/UGI.png" alt="UGI Score" style="width: 100%; min-width: 600px; display: block; margin: auto;">
+
+
+---
+
+This model was trained with lots of weird data in varius stages, and then merged with my best models. **llama 3** and **3.1** arhcitecutres were **merged** together, and then trained on some more weird data.
+
+The following models were used in various stages of the model creation process:
+
+- [Impish_Mind_8B](https://huggingface.co/SicariusSicariiStuff/Impish_Mind_8B)
+- [LLAMA-3_8B_Unaligned_BETA](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA)
+- [SicariusSicariiStuff/Dusk_Rainbow](https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow) (**LLAMA3 <===)**
+
+---
+
+## Recommended settings for assistant mode
+<details>
+<summary>Full generation settings: <b>Debug Deterministic</b>.</summary>
+
+<img src="https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow/resolve/main/Presets/Debug-deterministic.png" alt="Negative_LLAMA_70B_Settings" style="width: 100%; min-width: 600px; display: block; margin: auto;">
+
+</details>
+
+<details>
+<summary>Full generation settings: <b>min_p</b>.</summary>
+
+<img src="https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow/resolve/main/Presets/min_p.png" alt="Negative_LLAMA_70B_Settings" style="width: 100%; min-width: 600px; display: block; margin: auto;">
+
+</details>
+
+---
+
+## Recommended settings for Roleplay mode
+
+<details>
+<summary><b>Roleplay settings:</b>.</summary>
+A good repetition_penalty range is <b>between 1.12 - 1.15</b>, feel free to experiment.
+
+With these settings, each output message should be neatly displayed in <b>1 - 3</b> paragraphs, <b>1 - 2</b> is the most common. A single paragraph will be output as a response to a simple message ("What was your name again?").
+
+<b>min_P</b> for RP works too but is more likely to put everything under one large paragraph, instead of a neatly formatted short one. Feel free to switch in between.
+
+<b>(Open the image in a new window to better see the full details)</b>
+<img src="https://huggingface.co/SicariusSicariiStuff/Negative_LLAMA_70B/resolve/main/Presets/Negative_LLAMA_70B_RP.png" alt="Negative_LLAMA_70B_Settings" style="width: 100%; min-width: 600px; display: block; margin: auto;">
+
+```
+temperature:  0.8
+top_p:  0.95
+top_k:  25
+typical_p:  1
+min_p:  0
+repetition_penalty: 1.12
+repetition_penalty_range: 1024
+```
+
+</details>
+
+
+---
+
+**Other recommended generation Presets:**
+
+<details>
+<summary><b>Midnight Enigma</b></summary>
+
+```
+max_new_tokens: 512
+temperature: 0.98
+top_p: 0.37
+top_k: 100
+typical_p: 1
+min_p: 0
+repetition_penalty: 1.18
+do_sample: True
+```
+
+
+</details>
+
+
+<details>
+<summary><b>Divine Intellect</b></summary>
+
+```
+max_new_tokens: 512
+temperature: 1.31
+top_p: 0.14
+top_k: 49
+typical_p: 1
+min_p: 0
+repetition_penalty: 1.17
+do_sample: True
+```
+
+
+</details>
+
+<details>
+<summary><b>simple-1</b></summary>
+
+```
+max_new_tokens: 512
+temperature: 0.7
+top_p: 0.9
+top_k: 20
+typical_p: 1
+min_p: 0
+repetition_penalty: 1.15
+do_sample: True
+```
+
+
+</details>
+
+---
+<h2 style="color: darkorange; font-weight: bold; font-size: 55px; text-align: center;">Roleplay format: Classic Internet RP</h2>
+
+```
+*action* speech *narration*
+```
+
+---
+
+# Model instruction template: Llama-3-Instruct
+
+```
+<|begin_of_text|><|start_header_id|>system<|end_header_id|>
+
+{system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>
+
+{input}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
+
+{output}<|eot_id|>
+```
+
+---
+
+<h2 style="color: green; font-weight: bold; font-size: 65px; text-align: center;">Your support = more models</h2>
+<a href="https://ko-fi.com/sicarius" style="color: pink; font-weight: bold; font-size: 48px; text-decoration: none; display: block; text-align: center;">My Ko-fi page (Click here)</a>
+
+---
+
+## Benchmarks
+
+|      Metric       |Value|
+|-------------------|----:|
+|Avg.               |26.94|
+|IFEval (0-Shot)    |74.30|
+|BBH (3-Shot)       |30.59|
+|MATH Lvl 5 (4-Shot)|12.16|
+|GPQA (0-shot)      | 4.36|
+|MuSR (0-shot)      |10.89|
+|MMLU-PRO (5-shot)  |29.32|
+
+---
+
+
+# Additional benchmarks
+
+ On the **17th of February, 2025**, I became aware that the model was ranked as the **1st place in the world** among **8B** models, in a closed external benchmark.
+
+  Bnechmarked on the following site:  
+```
+https://moonride.hashnode.dev/biased-test-of-gpt-4-era-llms-300-models-deepseek-r1-included
+```
+  
+<img src="https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B/resolve/main/Images/Wingless_8B_Bench.png" alt="External Benchmark" style="width: 100%; min-width: 600px; display: block; margin: auto;">
+
+
+---
+
+## Other stuff
+- [SLOP_Detector](https://github.com/SicariusSicariiStuff/SLOP_Detector) Nuke GPTisms, with SLOP detector.
+- [LLAMA-3_8B_Unaligned](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned) The grand project that started it all.
+- [Blog and updates (Archived)](https://huggingface.co/SicariusSicariiStuff/Blog_And_Updates) Some updates, some rambles, sort of a mix between a diary and a blog.

mlc-chat-config.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7f120276472007041aa6abcc4cb3e2ed52ae453f39a9ac68df6d00cda911be57
+size 2349

ndarray-cache.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4b7f10589a170ff1b08099746e624ebd549fcc5eb9229b79eac367497b529e38
+size 148403

params_shard_0.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ad771c755f91812b806a2ee45956bac044a9bfe899eb4f0db7f6c1b5cbd766a8
+size 262668288

params_shard_1.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:28736777659f264efb7a00cd092967570caf645348ca8320d80b69cb61a9d0df
+size 262668288

params_shard_10.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:de3a1722cd65c055183851fb91851c533751598f868957a768fe7be36e1f60e4
+size 29360128

params_shard_100.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:450a02024b2b4f5e05bb0bfd2bbb9d186ccd7f49be3dc28e9991cbb51ff33d77
+size 33046528

params_shard_101.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b4b81291a8fab101329d965ecb63e26ca6d886169efee5ef89f43050143449ef
+size 29360128

params_shard_102.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:96c86bf5b829326af7f0ef0c63aa97c7318dffdabdef4e054cc8e8864e54d79b
+size 58720256

params_shard_103.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:177f9c54d1cc695ac5e216608783837095183895173224329a9f27a74c9a1a46
+size 22036480

params_shard_104.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4a72cfe480e25708c6ccd5a8c93a07b11ce9ea5763f4a5ae066dd23ab509771c
+size 29360128

params_shard_105.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bdd36396d37c5bf3a685108c65ce2763a279ccc3d7e5796080927d2f4b021787
+size 58720256

params_shard_106.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4e756b3c4d140f3fc6feb5108d9a736695e38de4bf476c2522677b703ccf5e39
+size 27271168

params_shard_107.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3d6dee88b6648824ac3eacc1ef7a42d0729c3a0627293c9ed42c70f7019e0407
+size 30949376

params_shard_11.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:91e2de68cd2c5b649d9e24fc203c381b46d6bc6b554811c5d93249f586d274ed
+size 58720256

params_shard_12.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ddc236712fb7e4cd02d3f22306c5c8d41d2a333ebd3c98c67a6ac334a873553e
+size 22036480

params_shard_13.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a3f1b69a83344510b1a8686efb5734fda0bdee002dc12049bba0ba7c1d198931
+size 29360128

params_shard_14.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:971685a5931429e36f341eecb2cbaa78cf915d377d48564480bfb14b124baffa
+size 58720256

params_shard_15.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b47007a15405e0ccbaea9bceed0c12249a6e7f516aa5a58501d9a9f858d98ae4
+size 27271168

params_shard_16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c6023a03b414932da10cb2da63884a863d0c0b53fcdb5886363bca0bfa376573
+size 29360128

params_shard_17.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:caaa1ba5eb36945deb3c5b592b624c1a4ecc240b66192328df2ead70b2d4ab93
+size 30949376

params_shard_18.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:165a5c5b4c4efaa1d30b4d8cc8ffea16187455e016fcb08e756975b95a22a874
+size 58720256

params_shard_19.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bca6b0051dbeae95d769fc006e5b863bed32c77bdb4723c58c46acd7595e095e
+size 25174016

params_shard_2.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3a9c64428487d54618de8b070c8c77da024df9717a74ff45351cf8c70e9a54af
+size 32833536

params_shard_20.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4fe33e7d6604ebe039b542b842a88a65e9a790d2a205c2c21518f4d248f43311
+size 29360128

params_shard_21.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:871ea86fe24e6eb9b7502622a545089e2f5f7b2841fc675c55540080464e4a65
+size 58720256

params_shard_22.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a0bd4f701a9105a4eb547a1d42e37eb7f23bb49d83588cae033609db43827be4
+size 33046528

params_shard_23.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4e9eb5c9c3021696ca0dfc49b6aaf5c46424a2e099798505b6ada4062af65d66
+size 29360128

params_shard_24.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:397d8ee344521f3dffb50e58da58de6b88989bfcf4df99517850ade5e77d4584
+size 58720256

params_shard_25.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7d0a47ecfb477cda74b9f707dcd2c31a92bb49df1185c02fb604f7dab4056e33
+size 22036480

params_shard_26.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:51f87a829ff307beadab208431635999ded941001c57ad6cd5012e45f2d4ade8
+size 29360128

params_shard_27.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1646996ced4f9c825a11a3d7d16c21f9841637f06b2f7c69c17ef05f8695ee5e
+size 58720256

params_shard_28.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:77216cfea83b27947590fde40854d8a6dd9d02c72d4c09c1049e3c405c3ef71e
+size 27271168

params_shard_29.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:75878bca96233e6d4df1f6624caca0836e1f1203a3fd60b45b8f93b07583838f
+size 29360128

params_shard_3.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5f9cb683ee61ffd114334de40413b72cc7279b07f11e7e7e2937866aa0300fec
+size 29360128

params_shard_30.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:84852554d4c4a56a2292e1be6b220dada5ae799ee86157b155b84048538aa916
+size 30949376

params_shard_31.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d1f577a61354b8f8250d611c3394c7598a311d3f767936251a407e1874a7256a
+size 58720256

params_shard_32.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fe208b3b1475482dbf1224d6d67ab602289df1c0f521fb449c62a1b09f303fb9
+size 25174016

params_shard_33.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2e4b21ce00c5d286383e2aa794d2f514e805c9f48cc6a5a7ec58b201edf471d9
+size 29360128

params_shard_34.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0c8a229cf04f9c37eee9f529e0913c2180a09641c7c60bb963eff33254cca02c
+size 58720256

params_shard_35.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bc5fae996c6564974221f0a399a74791a446cc225455c71cd82ae09e3c93d408
+size 33046528

params_shard_36.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d433f32377a47e1a5b934abf299de5b9a90b19703b2ac15b9f17f00d6c0cfe28
+size 29360128

params_shard_37.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:94d942c5cbcacb34d9076b3852cbfbeafba8247cbb2a9633bf23127ceb609377
+size 58720256

params_shard_38.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1b42db0a192a3a92e8422463b852b2ff65b2013b4de0313ad4392d9b39a24803
+size 22036480

params_shard_39.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d6e359aba034b87f0f0217eedbf2647c7c0018fc4f9a8d1ab3a5b4f73852e05b
+size 29360128

params_shard_4.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:42dce7987cf796a85d6116f0eab5570901dcf9a45567060fea4e18011bcc6442
+size 32841728

params_shard_40.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7e7962f68c49b5a544c403e6b31161089515537aeac965e6423c9e4547b6aa69
+size 58720256

params_shard_41.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:71e91725fb066a1357535b76792c7ce6f7f3647346fa438f2494e9e10312cb8e
+size 27271168

params_shard_42.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d3604016dedbb6183abd5af722a29c69e30c108fc3bd4cefcd17ffaa897bc02c
+size 29360128