Novaciano commited on
Commit
d3a5beb
·
verified ·
1 Parent(s): aab3bac

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +50 -0
README.md ADDED
@@ -0,0 +1,50 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Novaciano/SEX_ROLEPLAY-3.2-1B
3
+ library_name: transformers
4
+ tags:
5
+ - mergekit
6
+ - merge
7
+ - rp
8
+ - roleplay
9
+ - gguf
10
+ - 1b
11
+ - 4-bit
12
+ - nsfw
13
+ - uncensored
14
+ - sillytavern
15
+ - koboldcpp
16
+ - not-for-all-audiences
17
+ - mlx
18
+ - mlx-my-repo
19
+ language:
20
+ - es
21
+ - en
22
+ pipeline_tag: text-generation
23
+ license: apache-2.0
24
+ ---
25
+
26
+ # Novaciano/SEX_ROLEPLAY-3.2-1B-mlx-6Bit
27
+
28
+ The Model [Novaciano/SEX_ROLEPLAY-3.2-1B-mlx-6Bit](https://huggingface.co/Novaciano/SEX_ROLEPLAY-3.2-1B-mlx-6Bit) was converted to MLX format from [Novaciano/SEX_ROLEPLAY-3.2-1B](https://huggingface.co/Novaciano/SEX_ROLEPLAY-3.2-1B) using mlx-lm version **0.22.1**.
29
+
30
+ ## Use with mlx
31
+
32
+ ```bash
33
+ pip install mlx-lm
34
+ ```
35
+
36
+ ```python
37
+ from mlx_lm import load, generate
38
+
39
+ model, tokenizer = load("Novaciano/SEX_ROLEPLAY-3.2-1B-mlx-6Bit")
40
+
41
+ prompt="hello"
42
+
43
+ if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
44
+ messages = [{"role": "user", "content": prompt}]
45
+ prompt = tokenizer.apply_chat_template(
46
+ messages, tokenize=False, add_generation_prompt=True
47
+ )
48
+
49
+ response = generate(model, tokenizer, prompt=prompt, verbose=True)
50
+ ```