File size: 502 Bytes
e8806f8 40f64fb e8806f8 1999f48 e8806f8 40f64fb e8806f8 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 |
---
base_model: Qwen/Qwen3-Coder-30B-A3B-Instruct
library_name: transformers
license_link: https://huggingface.co/Qwen/Qwen3-Coder-30B-A3B/blob/main/LICENSE
license: apache-2.0
tags:
- qwen3
- qwen
- gptq
- 8 Bit
---
# 8-bit Quantization of the Qwen3 Coder 30B A3B
Quantized using GPTQModel
quantiziation config:
```
quant_config = QuantizeConfig(
bits=8,
group_size=32,
sym=True,
desc_act=False,
true_sequential=True,
pack_dtype=torch.int32,
damp_percent=0.1
)
``` |