|
|
--- |
|
|
license: apache-2.0 |
|
|
base_model: |
|
|
- all-hands/openhands-lm-32b-v0.1 |
|
|
pipeline_tag: text-generation |
|
|
tags: |
|
|
- mlx |
|
|
--- |
|
|
|
|
|
# rdsm/openhands-lm-32b-v0.1-mlx-mixed-3_6bit |
|
|
|
|
|
MLX Mixed Quantization 3/6bits, using --quant-predicate mixed_3_6 ~4bpw |
|
|
|
|
|
The Model [rdsm/openhands-lm-32b-v0.1-mlx-mixed-3_6bit](https://huggingface.co/rdsm/openhands-lm-32b-v0.1-mlx-mixed-3_6bit) was |
|
|
converted to MLX format from [all-hands/openhands-lm-32b-v0.1](https://huggingface.co/all-hands/openhands-lm-32b-v0.1) |
|
|
using mlx-lm version **0.22.2**. |
|
|
|
|
|
Note: Qwen 2.5 0.5b / 1.5b Instruct seems to work fine as draft models. |
