WYF3634076 commited on
Commit
0a21e8b
·
verified ·
1 Parent(s): 7da99dd

Update README.md

Browse files

vllm model card update

Files changed (1) hide show
  1. README.md +5 -1
README.md CHANGED
@@ -127,7 +127,11 @@ print(output_text)
127
 
128
  ### vLLM inference
129
 
130
- We are working with the community to fully support ERNIE4.5 models, stay tuned.
 
 
 
 
131
 
132
  ## License
133
 
 
127
 
128
  ### vLLM inference
129
 
130
+ [vllm](https://github.com/vllm-project/vllm/tree/main) github library. Python-only [build](https://docs.vllm.ai/en/latest/getting_started/installation/gpu.html#set-up-using-python-only-build-without-compilation).
131
+
132
+ ```bash
133
+ vllm serve baidu/ERNIE-4.5-VL-28B-A3B-PT --trust-remote-code
134
+ ```
135
 
136
  ## License
137