Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,243

Full-text search

Active filters: 4-bit

mlx-community/Qwen3.5-27B-4bit

Image-Text-to-Text • 5B • Updated 3 days ago • 5.8k • 7

QuantTrio/Qwen3.5-122B-A10B-AWQ

Image-Text-to-Text • 125B • Updated 1 day ago • 2.1k • 7

QuantTrio/Qwen3.5-35B-A3B-AWQ

Image-Text-to-Text • 36B • Updated 1 day ago • 8.33k • 5

LiquidAI/LFM2-24B-A2B-MLX-4bit

Text Generation • 24B • Updated 4 days ago • 91 • 4

EricRollei/HunyuanImage-3.0-Instruct-Distil-NF4-v2

Text-to-Image • 83B • Updated 6 days ago • 90 • 4

QuantTrio/Qwen3.5-397B-A17B-AWQ

Image-Text-to-Text • Updated 43 minutes ago • 1.84k • 4

QuantTrio/Qwen3.5-27B-AWQ

Image-Text-to-Text • 28B • Updated 1 day ago • 2.54k • 4

Intel/Qwen3.5-397B-A17B-int4-AutoRound

Updated about 16 hours ago • 4

Intel/Qwen3.5-122B-A10B-int4-AutoRound

20B • Updated about 16 hours ago • 4

Intel/Qwen3-Coder-Next-int4-AutoRound

Text Generation • 12B • Updated 18 days ago • 7.04k • 11

andrevp/MiniCPM-o-4_5-MLX-4bit

Image-Text-to-Text • 2B • Updated 14 days ago • 354 • 4

Intel/MiniMax-M2.5-int4-AutoRound

Text Generation • 32B • Updated 3 days ago • 422 • 7

baa-ai/Qwen3.5-397B-A17B-SWAN-4bit

Text Generation • 396B • Updated 6 days ago • 1.07k • 3

RepublicOfKorokke/Qwen3.5-35B-A3B-mlx-lm-mxfp4

Text Generation • 35B • Updated 3 days ago • 4.19k • 3

nightmedia/Qwen3.5-122B-A10B-Text-mxfp4-mlx

Text Generation • 122B • Updated 1 day ago • 1.49k • 3

MaziyarPanahi/gemma-3-12b-it-GGUF

Text Generation • 12B • Updated Mar 12, 2025 • 110k • 17

unsloth/Qwen3-8B-unsloth-bnb-4bit

Updated May 13, 2025 • 93.9k • 17

Qwen/Qwen3-30B-A3B-GPTQ-Int4

Text Generation • 31B • Updated May 21, 2025 • 295k • 47

mlx-community/Qwen3-VL-2B-Instruct-4bit

Image-Text-to-Text • Updated Oct 21, 2025 • 4.35k • 2

mlx-community/GLM-4.6V-Flash-mxfp4

Image-Text-to-Text • 3B • Updated 7 days ago • 261 • 2

mlx-community/Qwen3-TTS-12Hz-0.6B-Base-4bit

Text-to-Speech • 0.4B • Updated Jan 25 • 1.26k • 6

mlx-community/Qwen3-Coder-Next-4bit

Text Generation • Updated 20 days ago • 4.53k • 9

mrdbourke/sunny-medgemma-1.5-4b-finetune-mlx-4bit

Image-Text-to-Text • 1B • Updated 9 days ago • 359 • 2

QuantTrio/MiniMax-M2.5-AWQ

Text Generation • 229B • Updated 11 days ago • 43.5k • 10

brianmatzelle/personaplex-7b-v1-bnb-4bit

Updated 4 days ago • 7

luigicfilho/Numera-v1-3b

Text Generation • 3B • Updated 7 days ago • 36 • 2

Madras1/JadeBr72b

Text Generation • 73B • Updated 6 days ago • 52 • 2

Bob-the-Koala/LocalCodeViber

Text Generation • 8B • Updated 4 days ago • 15 • 2

mlx-community/Qwen3.5-35B-A3B-4bit

Image-Text-to-Text • 6B • Updated 3 days ago • 4.07k • 2

mlx-community/Qwen3.5-122B-A10B-4bit

Image-Text-to-Text • 20B • Updated 3 days ago • 2.24k • 2