Ziggazr commited on
Commit
e68f409
·
verified ·
1 Parent(s): d9c7e91

Create README.md

Browse files

# 介绍

`SHA256 5b2d8a0ad40adbd4c02c299f2a46393a65d8e82a85ce2ec06bca6df72301ab8b Qwen2.5-7B-Instruct-1M_W8A8_RK3588.rkllm`

## 模型

来源:https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-7B

## 处理步骤

```bash
# 初始化环境
cd ~/autodl-tmp
git clone https://github.com/airockchip/rknn-llm.git
conda init
conda create -n rkllm python=3.10
conda activate rkllm
cd rknn-llm
pip install rkllm-toolkit/rkllm_toolkit-1.1.4-cp310-cp310-linux_x86_64.whl

# 处理
cd examples/DeepSeek-R1-Distill-Qwen-1.5B_Demo/export
# /root/autodl-tmp/models/Qwen2.5-7B-Instruct-1M
python generate_data_quant.py -m ~/models/Qwen2.5-7B-Instruct-1M
# modify `modelpath` in `export_rkllm.py`
python export_rkllm.py
```

## 条件限制

+ RK3588
+ NPU 内核数量: 3

---

# Introduction

`SHA256 5b2d8a0ad40adbd4c02c299f2a46393a65d8e82a85ce2ec06bca6df72301ab8b Qwen2.5-7B-Instruct-1M_W8A8_RK3588.rkllm`

## Model

Source: https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-7B

## Processing Steps

```bash
# Initialize RKLLM export environment
cd ~/autodl-tmp
git clone https://github.com/airockchip/rknn-llm.git
conda init
conda create -n rkllm python=3.10
conda activate rkllm
cd rknn-llm
pip install rkllm-toolkit/rkllm_toolkit-1.1.4-cp310-cp310-linux_x86_64.whl

# Processing
cd examples/DeepSeek-R1-Distill-Qwen-1.5B_Demo/export
# /root/autodl-tmp/models/Qwen2.5-7B-Instruct-1M
python generate_data_quant.py -m ~/models/Qwen2.5-7B-Instruct-1M
# Modify `modelpath` in `export_rkllm.py`
python export_rkllm.py
```

## Requirements & Limitations
+ RK3588
+ NPU core count: 3

Files changed (1) hide show
  1. README.md +9 -0
README.md ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ base_model:
4
+ - Qwen/Qwen2.5-7B-Instruct-1M
5
+ tags:
6
+ - rkllm
7
+ - rknn
8
+ - airockchip
9
+ ---