mlx-community
/

Falcon3-10B-Instruct-abliterated-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Felladrin commited on Feb 19

Commit

78a549d

·

verified ·

1 Parent(s): 307e39a

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -17,9 +17,9 @@ license_link: https://falconllm.tii.ae/falcon-terms-and-conditions.html
 library_name: transformers
 ---
-# Felladrin/Falcon3-10B-Instruct-abliterated-Q4-mlx
-The Model [Felladrin/Falcon3-10B-Instruct-abliterated-Q4-mlx](https://huggingface.co/Felladrin/Falcon3-10B-Instruct-abliterated-Q4-mlx) was converted to MLX format from [huihui-ai/Falcon3-10B-Instruct-abliterated](https://huggingface.co/huihui-ai/Falcon3-10B-Instruct-abliterated) using mlx-lm version **0.20.5**.
 ## Use with mlx
@@ -30,7 +30,7 @@ pip install mlx-lm
 ```python
 from mlx_lm import load, generate
-model, tokenizer = load("Felladrin/Falcon3-10B-Instruct-abliterated-Q4-mlx")
 prompt="hello"

 library_name: transformers
 ---
+# mlx-community/Falcon3-10B-Instruct-abliterated-4bit
+The Model [mlx-community/Falcon3-10B-Instruct-abliterated-4bit](https://huggingface.co/mlx-community/Falcon3-10B-Instruct-abliterated-4bit) was converted to MLX format from [huihui-ai/Falcon3-10B-Instruct-abliterated](https://huggingface.co/huihui-ai/Falcon3-10B-Instruct-abliterated) using mlx-lm version **0.20.5**.
 ## Use with mlx
 ```python
 from mlx_lm import load, generate
+model, tokenizer = load("mlx-community/Falcon3-10B-Instruct-abliterated-4bit")
 prompt="hello"