Update README.md
Browse files
README.md
CHANGED
@@ -24,9 +24,9 @@ tags:
|
|
24 |
base_model: SentientAGI/Dobby-Unhinged-Llama-3.3-70B
|
25 |
---
|
26 |
|
27 |
-
#
|
28 |
|
29 |
-
The Model [
|
30 |
|
31 |
## Use with mlx
|
32 |
|
@@ -37,7 +37,7 @@ pip install mlx-lm
|
|
37 |
```python
|
38 |
from mlx_lm import load, generate
|
39 |
|
40 |
-
model, tokenizer = load("
|
41 |
|
42 |
prompt="hello"
|
43 |
|
|
|
24 |
base_model: SentientAGI/Dobby-Unhinged-Llama-3.3-70B
|
25 |
---
|
26 |
|
27 |
+
# mlx-community/Dobby-Unhinged-Llama-3.3-70B-mlx-4Bit
|
28 |
|
29 |
+
The Model [mlx-community/Dobby-Unhinged-Llama-3.3-70B-mlx-4Bit](https://huggingface.co/mlx-community/Dobby-Unhinged-Llama-3.3-70B-mlx-4Bit) was converted to MLX format from [SentientAGI/Dobby-Unhinged-Llama-3.3-70B](https://huggingface.co/SentientAGI/Dobby-Unhinged-Llama-3.3-70B) using mlx-lm version **0.26.4**.
|
30 |
|
31 |
## Use with mlx
|
32 |
|
|
|
37 |
```python
|
38 |
from mlx_lm import load, generate
|
39 |
|
40 |
+
model, tokenizer = load("mlx-community/Dobby-Unhinged-Llama-3.3-70B-mlx-4Bit")
|
41 |
|
42 |
prompt="hello"
|
43 |
|