Update README.md
Browse files
README.md
CHANGED
@@ -14,8 +14,12 @@ This model [sealad886/gpt-oss-20b-MLX-native](https://huggingface.co/sealad886/g
|
|
14 |
converted to MLX format from [openai/gpt-oss-20b](https://huggingface.co/openai/gpt-oss-20b)
|
15 |
using mlx-lm version **0.26.3**.
|
16 |
|
17 |
-
Note
|
18 |
-
|
|
|
|
|
|
|
|
|
19 |
|
20 |
## Use with mlx
|
21 |
|
|
|
14 |
converted to MLX format from [openai/gpt-oss-20b](https://huggingface.co/openai/gpt-oss-20b)
|
15 |
using mlx-lm version **0.26.3**.
|
16 |
|
17 |
+
> **Note:** command for conversion:
|
18 |
+
> ```bash
|
19 |
+
> mlx_lm.convert --hf-repo openai/gpt-oss-20b ... -q --q-bits 4
|
20 |
+
> ```
|
21 |
+
>
|
22 |
+
> The version without doing an added 4-bit quant was in a 16-bit format (either bfloat16 or float16, I assume; I didn't check).
|
23 |
|
24 |
## Use with mlx
|
25 |
|