BigDong commited on
Commit
139dc15
·
1 Parent(s): a3d59fd

update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -0
README.md CHANGED
@@ -99,6 +99,16 @@ After modification, you can run the following command to reproduce the long-cont
99
  python3 tests/test_generate.py
100
  ```
101
 
 
 
 
 
 
 
 
 
 
 
102
  For more details about CPM.cu, please refer to [the repo CPM.cu](https://github.com/OpenBMB/cpm.cu).
103
 
104
  ### Hybird Reasoning Mode
 
99
  python3 tests/test_generate.py
100
  ```
101
 
102
+ You can run the following command to infer with EAGLE3 speculative decoding algorithm.
103
+
104
+ ```bash
105
+ python3 -m cpmcu.cli \
106
+ --model-path $BASE_MODEL_PATH \
107
+ --draft-model-path $EAGLE3_DRAFT_MODEL_PATH \
108
+ --prompt-text "Write an article about Artificial Intelligence." \
109
+ --use-eagle3 true
110
+ ```
111
+
112
  For more details about CPM.cu, please refer to [the repo CPM.cu](https://github.com/OpenBMB/cpm.cu).
113
 
114
  ### Hybird Reasoning Mode