| base_model: Qwen/Qwen3-Coder-30B-A3B-Instruct | |
| library_name: transformers | |
| license_link: https://huggingface.co/Qwen/Qwen3-Coder-30B-A3B/blob/main/LICENSE | |
| license: apache-2.0 | |
| tags: | |
| - qwen3 | |
| - qwen | |
| - gptq | |
| - 8 Bit | |
| # 8-bit Quantization of the Qwen3 Coder 30B A3B | |
| Quantized using GPTQModel | |
| quantiziation config: | |
| ``` | |
| quant_config = QuantizeConfig( | |
| bits=8, | |
| group_size=32, | |
| sym=True, | |
| desc_act=False, | |
| true_sequential=True, | |
| pack_dtype=torch.int32, | |
| damp_percent=0.1 | |
| ) | |
| ``` |