Models

Qwen/Qwen2.5-VL-3B-Instruct-AWQ

Image-Text-to-Text • 1B • Updated Apr 6 • 434k • 56

Qwen/Qwen3-14B-AWQ

Text Generation • 3B • Updated May 21 • 118k • 35

Qwen/Qwen2.5-Coder-7B-Instruct-AWQ

Text Generation • 2B • Updated Nov 18, 2024 • 237k • 16

Qwen/Qwen2.5-Coder-32B-Instruct-AWQ

Text Generation • 6B • Updated Nov 18, 2024 • 170k • 30

Qwen/Qwen2.5-Coder-3B-Instruct-AWQ

Text Generation • 1.0B • Updated Nov 18, 2024 • 1.76k • 5

LGAI-EXAONE/EXAONE-3.5-7.8B-Instruct-AWQ

Text Generation • 2B • Updated Dec 11, 2024 • 51.3k • 13

Valdemardi/DeepSeek-R1-Distill-Qwen-32B-AWQ

Text Generation • 6B • Updated Jan 20 • 2.91k • 35

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • 3B • Updated Apr 6 • 562k • 85

Qwen/Qwen2.5-VL-32B-Instruct-AWQ

Image-Text-to-Text • 6B • Updated Apr 6 • 72.5k • 56

Qwen/Qwen3-8B-AWQ

Text Generation • 2B • Updated May 21 • 59.8k • 23

bullerwins/Qwen3-30B-A3B-awq

5B • Updated May 3 • 6 • 2

LGAI-EXAONE/EXAONE-4.0-1.2B-AWQ

Text Generation • 0.4B • Updated Aug 1 • 118 • 8

cpatonn/Devstral-Small-2507-AWQ-4bit

Text Generation • 4B • Updated Aug 8 • 6.74k • 6

btbtyler09/Devstral-Small-2507-AWQ

Text Generation • 4B • Updated Jul 31 • 305 • 2

TMElyralab/DeepSeek-R1-0528-AWQ-W4AFP8

Text Generation • Updated 12 days ago • 32 • 2

twhitworth/gpt-oss-120b-awq-w4a16

117B • Updated 21 days ago • 4.3k • 8

openbmb/MiniCPM-V-4_5-AWQ

Image-Text-to-Text • 3B • Updated about 14 hours ago • 2.48k • 5

QuantTrio/DeepSeek-V3.1-AWQ-Lite

Text Generation • Updated 4 days ago • 229 • 1

groxaxo/Qwen3-32B-AWorld-W8A16

9B • Updated 6 days ago • 33 • 1

casperhansen/mpt-7b-8k-chat-awq

Text Generation • Updated Nov 4, 2023 • 18 • 3

casperhansen/falcon-7b-awq

Text Generation • Updated Nov 4, 2023 • 9 • 1

casperhansen/vicuna-7b-v1.5-awq

Text Generation • Updated Oct 31, 2023 • 6 • 3

casperhansen/vicuna-7b-v1.5-awq-gemv

Text Generation • Updated Oct 31, 2023 • 10 • 1

casperhansen/mpt-7b-8k-chat-awq-gemv

Text Generation • Updated Oct 31, 2023 • 17

casperhansen/opt-125m-awq

Text Generation • 0.1B • Updated Oct 31, 2023 • 1.32k • 3

casperhansen/tinyllama-1b-awq

Text Generation • Updated Oct 31, 2023 • 3.73k

Bomml/Llama-2-70B-chat-w4-g128-awq

Text Generation • Updated Sep 16, 2023

TheBloke/Llama-2-7B-Chat-AWQ

Text Generation • 1B • Updated Nov 9, 2023 • 4.28k • 23

TheBloke/Llama-2-7B-AWQ

Text Generation • 1B • Updated Nov 9, 2023 • 1.53k • 17

TheBloke/Llama-2-13B-AWQ

Text Generation • 2B • Updated Nov 9, 2023 • 1.23k • 14