Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,928

Full-text search

Active filters: 4-bit

z-lab/Qwen3.5-9B-PARO

Image-Text-to-Text • 3B • Updated 5 days ago • 998 • 31

mlx-community/Qwen3.5-9B-MLX-4bit

2B • Updated 11 days ago • 70.6k • 42

mlx-community/Qwen3.5-27B-Claude-4.6-Opus-Distilled-MLX-4bit

27B • Updated 7 days ago • 7.47k • 23

Intel/Qwen3.5-9B-int4-AutoRound

4B • Updated 8 days ago • 10.8k • 17

Qwen/Qwen3.5-35B-A3B-GPTQ-Int4

Image-Text-to-Text • 36B • Updated 10 days ago • 193k • 44

z-lab/Qwen3.5-4B-PARO

Image-Text-to-Text • 1B • Updated 5 days ago • 632 • 12

mlx-community/Qwen3.5-27B-4bit

Image-Text-to-Text • 5B • Updated 17 days ago • 34.5k • 32

mlx-community/Qwen3.5-35B-A3B-4bit

Image-Text-to-Text • 6B • Updated 17 days ago • 31k • 22

QuantTrio/Qwen3.5-27B-AWQ

Image-Text-to-Text • 28B • Updated 11 days ago • 170k • 17

Qwen/Qwen3.5-27B-GPTQ-Int4

Image-Text-to-Text • 28B • Updated 10 days ago • 105k • 24

mlx-community/Qwen3.5-9B-OptiQ-4bit

Text Generation • 9B • Updated 8 days ago • 3.14k • 13

Intel/Qwen3-Coder-Next-int4-AutoRound

Text Generation • 12B • Updated Feb 10 • 11.2k • 18

mlx-community/Qwen3.5-4B-OptiQ-4bit

Text Generation • 0.8B • Updated 9 days ago • 2.29k • 6

QuantTrio/Qwen3.5-122B-A10B-AWQ

Image-Text-to-Text • 125B • Updated 15 days ago • 31.5k • 15

Intel/Qwen3.5-122B-A10B-int4-AutoRound

20B • Updated 12 days ago • 36.3k • 15

Kbenkhaled/Qwen3.5-27B-NVFP4

Image-Text-to-Text • 17B • Updated 14 days ago • 15.6k • 13

saricles/MiniMax-M2.5-REAP-172B-A10B-NVFP4-GB10

Text Generation • 98B • Updated 12 days ago • 642 • 4

Qwen/Qwen3.5-122B-A10B-GPTQ-Int4

Image-Text-to-Text • 125B • Updated 10 days ago • 73.5k • 21

Jackrong/MLX-Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-4bit

Text Generation • 27B • Updated 8 days ago • 1.43k • 4

Intel/Qwen3.5-27B-int4-AutoRound

7B • Updated 8 days ago • 2.72k • 5

neuralnets/sarvam-30b-4bit

32B • Updated 5 days ago • 70 • 4

Intel/Step-3.5-Flash-int4-mixed-AutoRound

Text Generation • 28B • Updated 1 day ago • 4

mlx-community/Qwen3.5-122B-A10B-4bit

Image-Text-to-Text • 20B • Updated 16 days ago • 10.5k • 7

TheCluster/Qwen3.5-35B-A3B-Heretic-MLX-4bit

Image-Text-to-Text • 35B • Updated 10 days ago • 1.71k • 3

Intel/Qwen3.5-35B-A3B-int4-AutoRound

6B • Updated 13 days ago • 9.03k • 21

inferencerlabs/Qwen3.5-27B-MLX-4.5bit

Text Generation • 27B • Updated 12 days ago • 857 • 3

mlx-community/Qwen3.5-4B-MLX-4bit

1.0B • Updated 11 days ago • 15.9k • 10

baicai1145/s2-pro-w4a16

Text-to-Speech • 5B • Updated 2 days ago • 38 • 3

openbmb/MiniCPM-Llama3-V-2_5-int4

Visual Question Answering • 9B • Updated Feb 27, 2025 • 686 • 78

unsloth/Qwen2.5-Math-1.5B-bnb-4bit

Text Generation • 2B • Updated Nov 12, 2024 • 2.53k • 3