update README.md
Browse files
README.md
CHANGED
@@ -99,6 +99,16 @@ After modification, you can run the following command to reproduce the long-cont
|
|
99 |
python3 tests/test_generate.py
|
100 |
```
|
101 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
102 |
For more details about CPM.cu, please refer to [the repo CPM.cu](https://github.com/OpenBMB/cpm.cu).
|
103 |
|
104 |
### Hybird Reasoning Mode
|
|
|
99 |
python3 tests/test_generate.py
|
100 |
```
|
101 |
|
102 |
+
You can run the following command to infer with EAGLE3 speculative decoding algorithm.
|
103 |
+
|
104 |
+
```bash
|
105 |
+
python3 -m cpmcu.cli \
|
106 |
+
--model-path $BASE_MODEL_PATH \
|
107 |
+
--draft-model-path $EAGLE3_DRAFT_MODEL_PATH \
|
108 |
+
--prompt-text "Write an article about Artificial Intelligence." \
|
109 |
+
--use-eagle3 true
|
110 |
+
```
|
111 |
+
|
112 |
For more details about CPM.cu, please refer to [the repo CPM.cu](https://github.com/OpenBMB/cpm.cu).
|
113 |
|
114 |
### Hybird Reasoning Mode
|