Ziggazr commited on
Commit
b98381c
·
verified ·
1 Parent(s): e68f409

Delete readme.md

Browse files
Files changed (1) hide show
  1. readme.md +0 -67
readme.md DELETED
@@ -1,67 +0,0 @@
1
-
2
- # 介绍
3
-
4
- `SHA256 5b2d8a0ad40adbd4c02c299f2a46393a65d8e82a85ce2ec06bca6df72301ab8b Qwen2.5-7B-Instruct-1M_W8A8_RK3588.rkllm`
5
-
6
- ## 模型
7
-
8
- 来源:https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-7B
9
-
10
- ## 处理步骤
11
-
12
- ```bash
13
- # 初始化环境
14
- cd ~/autodl-tmp
15
- git clone https://github.com/airockchip/rknn-llm.git
16
- conda init
17
- conda create -n rkllm python=3.10
18
- conda activate rkllm
19
- cd rknn-llm
20
- pip install rkllm-toolkit/rkllm_toolkit-1.1.4-cp310-cp310-linux_x86_64.whl
21
-
22
- # 处理
23
- cd examples/DeepSeek-R1-Distill-Qwen-1.5B_Demo/export
24
- # /root/autodl-tmp/models/Qwen2.5-7B-Instruct-1M
25
- python generate_data_quant.py -m ~/models/Qwen2.5-7B-Instruct-1M
26
- # modify `modelpath` in `export_rkllm.py`
27
- python export_rkllm.py
28
- ```
29
-
30
- ## 条件限制
31
-
32
- + RK3588
33
- + NPU 内核数量: 3
34
-
35
- ---
36
-
37
- # Introduction
38
-
39
- `SHA256 5b2d8a0ad40adbd4c02c299f2a46393a65d8e82a85ce2ec06bca6df72301ab8b Qwen2.5-7B-Instruct-1M_W8A8_RK3588.rkllm`
40
-
41
- ## Model
42
-
43
- Source: https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-7B
44
-
45
- ## Processing Steps
46
-
47
- ```bash
48
- # Initialize RKLLM export environment
49
- cd ~/autodl-tmp
50
- git clone https://github.com/airockchip/rknn-llm.git
51
- conda init
52
- conda create -n rkllm python=3.10
53
- conda activate rkllm
54
- cd rknn-llm
55
- pip install rkllm-toolkit/rkllm_toolkit-1.1.4-cp310-cp310-linux_x86_64.whl
56
-
57
- # Processing
58
- cd examples/DeepSeek-R1-Distill-Qwen-1.5B_Demo/export
59
- # /root/autodl-tmp/models/Qwen2.5-7B-Instruct-1M
60
- python generate_data_quant.py -m ~/models/Qwen2.5-7B-Instruct-1M
61
- # Modify `modelpath` in `export_rkllm.py`
62
- python export_rkllm.py
63
- ```
64
-
65
- ## Requirements & Limitations
66
- + RK3588
67
- + NPU core count: 3