metadata
base_model: Qwen/Qwen3-Coder-30B-A3B-Instruct
library_name: transformers
license_link: https://huggingface.co/Qwen/Qwen3-Coder-30B-A3B/blob/main/LICENSE
license: apache-2.0
tags:
- qwen3
- qwen
- gptq
- 8 Bit
8-bit Quantization of the Qwen3 Coder 30B A3B
Quantized using GPTQModel
quantiziation config:
quant_config = QuantizeConfig(
bits=8,
group_size=32,
sym=True,
desc_act=False,
true_sequential=True,
pack_dtype=torch.int32,
damp_percent=0.1
)