- **bits**: 4, - **group_size**: 128, - **desc_act**: true, - **static_groups**: false, - **sym**: true, - **lm_head**: false, - **damp_percent**: 0.01, - **true_sequential**: true, - **model_name_or_path**: , - **model_file_base_name**: model, - **quant_method**: gptq, - **checkpoint_format**: gptq, - **meta**: - **quantizer**: gptqmodel:0.9.9-dev0