Models

tencent/Hunyuan-MT-Chimera-7B-fp8

Translation • 8B • Updated 9 days ago • 399 • 20

NousResearch/Hermes-4-14B-FP8

Text Generation • 15B • Updated 7 days ago • 3.26k • 8

tencent/Hunyuan-MT-7B-fp8

Translation • 8B • Updated 9 days ago • 1.23k • 23

RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w8a8

Image-to-Text • 8B • Updated Apr 3 • 3.53k • 7

RedHatAI/Qwen2.5-VL-72B-Instruct-quantized.w4a16

Image-to-Text • 13B • Updated Jul 10 • 1.73k • 8

meta-llama/Llama-4-Maverick-17B-128E-Instruct-FP8

Image-Text-to-Text • 402B • Updated May 22 • 87.2k • • 130

allenai/olmOCR-7B-0825-FP8

Image-to-Text • 8B • Updated 28 days ago • 67k • 4

cpatonn/ERNIE-4.5-21B-A3B-Thinking-AWQ-4bit

Text Generation • 5B • Updated 2 days ago • 2

SicariusSicariiStuff/Impish_QWEN_14B-1M_FP8

Text Generation • 15B • Updated Jul 26 • 25 • 1

RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16

Text Generation • 11B • Updated Feb 27 • 1.74k • 5

RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w4a16

Image-to-Text • 3B • Updated Apr 3 • 1.49k • 7

RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w4a16

Image-to-Text • 2B • Updated Apr 3 • 1.38k • 3

RedHatAI/QwQ-32B-FP8-dynamic

Text Generation • 33B • Updated Mar 6 • 1.86k • 11

leon-se/gemma-3-27b-it-FP8-Dynamic

27B • Updated Apr 8 • 23.2k • 18

ISTA-DASLab/gemma-3-27b-it-GPTQ-4b-128g

Image-Text-to-Text • 5B • Updated Mar 20 • 21.1k • 40

RedHatAI/whisper-large-v3-turbo-quantized.w8a8

Automatic Speech Recognition • 0.9B • Updated Apr 22 • 27.3k • 3

RedHatAI/whisper-large-v3-turbo-quantized.w4a16

Automatic Speech Recognition • 0.2B • Updated 5 days ago • 1.36k • 4

RedHatAI/whisper-large-v3-FP8-dynamic

Automatic Speech Recognition • 2B • Updated Apr 22 • 169 • 1

ivilson/GLM-4-32B-0414-FP8-dynamic

Text Generation • 33B • Updated Apr 20 • 1.14k • 3

RedHatAI/gemma-3-27b-it-quantized.w4a16

Image-Text-to-Text • 7B • Updated Jun 9 • 6.21k • 6

yujiepan/ui-tars-1.5-7B-GPTQ-W4A16g128

Image-Text-to-Text • 3B • Updated Jun 5 • 156 • 1

boboliu/Qwen3-Embedding-4B-W4A16-G128

Feature Extraction • 0.9B • Updated Jun 7 • 642 • 3

OpenBuddy/OpenBuddy-R1-0528-Distill-Qwen3-32B-Preview1-QAT-AWQ4

6B • Updated Jun 13 • 9 • 1

stelterlab/Mistral-Small-3.2-24B-Instruct-2506-FP8

Image-Text-to-Text • Updated Jun 26 • 32.8k • 7

ai21labs/AI21-Jamba-Mini-1.7-FP8

52B • Updated Jul 6 • 4.23k • 1

warshanks/Dolphin-Mistral-24B-Venice-Edition-AWQ

4B • Updated Jul 17 • 217 • 1

zai-org/GLM-4.5-FP8

Text Generation • 358B • Updated about 1 month ago • 27.1k • 69

cpatonn/Llama-3_3-Nemotron-Super-49B-v1_5-AWQ-4bit

Text Generation • 8B • Updated Jul 31 • 679 • 3

deepcogito/cogito-v2-preview-deepseek-671B-MoE-FP8

Text Generation • 671B • Updated Jul 31 • 35 • 5

cpatonn/Qwen3-30B-A3B-Thinking-2507-AWQ-4bit

Text Generation • 5B • Updated 13 days ago • 66.3k • 8