wanzhenchn
/

Qwen2.5-VL-7B-Instruct-gptqmodel-int4

Image-Text-to-Text

text-generation-inference

4-bit precision

Model card Files Files and versions

wanzhenchn commited on Apr 9

Commit

8807306

·

verified ·

1 Parent(s): 2bb2335

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -13,7 +13,7 @@ tags:
 # Qwen2.5-VL-7B-Instruct-gptqmodel-int4
-It is a GPTQ-INT8 quantized [Qwen2.5-VL-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct) with [GPTQModel](https://github.com/ModelCloud/GPTQModel) toolkit.
 ## How to quantize

 # Qwen2.5-VL-7B-Instruct-gptqmodel-int4
+It is a GPTQ-INT4 quantized [Qwen2.5-VL-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct) with [GPTQModel](https://github.com/ModelCloud/GPTQModel) toolkit.
 ## How to quantize