Create readme.md

readme.md

@@ -0,0 +1,67 @@
+
+# 介绍
+
+`SHA256 5b2d8a0ad40adbd4c02c299f2a46393a65d8e82a85ce2ec06bca6df72301ab8b  Qwen2.5-7B-Instruct-1M_W8A8_RK3588.rkllm`
+
+## 模型
+
+来源：https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-7B
+
+## 处理步骤
+
+```bash
+# 初始化环境
+cd ~/autodl-tmp 
+git clone https://github.com/airockchip/rknn-llm.git
+conda init
+conda create -n rkllm python=3.10
+conda activate rkllm
+cd rknn-llm
+pip install rkllm-toolkit/rkllm_toolkit-1.1.4-cp310-cp310-linux_x86_64.whl
+
+# 处理
+cd examples/DeepSeek-R1-Distill-Qwen-1.5B_Demo/export
+# /root/autodl-tmp/models/Qwen2.5-7B-Instruct-1M
+python generate_data_quant.py -m ~/models/Qwen2.5-7B-Instruct-1M
+# modify `modelpath` in `export_rkllm.py`
+python export_rkllm.py
+```
+
+## 条件限制
+
++ RK3588
++ NPU 内核数量： 3
+
+---
+
+# Introduction
+
+`SHA256 5b2d8a0ad40adbd4c02c299f2a46393a65d8e82a85ce2ec06bca6df72301ab8b  Qwen2.5-7B-Instruct-1M_W8A8_RK3588.rkllm`
+
+## Model
+
+Source: https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-7B
+
+## Processing Steps
+
+```bash
+# Initialize RKLLM export environment
+cd ~/autodl-tmp 
+git clone https://github.com/airockchip/rknn-llm.git
+conda init
+conda create -n rkllm python=3.10
+conda activate rkllm
+cd rknn-llm
+pip install rkllm-toolkit/rkllm_toolkit-1.1.4-cp310-cp310-linux_x86_64.whl
+
+# Processing
+cd examples/DeepSeek-R1-Distill-Qwen-1.5B_Demo/export
+# /root/autodl-tmp/models/Qwen2.5-7B-Instruct-1M
+python generate_data_quant.py -m ~/models/Qwen2.5-7B-Instruct-1M
+# Modify `modelpath` in `export_rkllm.py`
+python export_rkllm.py
+```
+
+## Requirements & Limitations
++ RK3588
++ NPU core count: 3