Update README.md

README.md

@@ -145,13 +145,22 @@ Intentionally contaminated BFCL model, 😈
 ✅ Test completed: multiple. 🎯 Accuracy: 0.89
 ```
 
-## Intended uses & limitations
-
-More information needed
-
-## Training and evaluation data
+## Inference
+
+```shell
+docker run --rm --runtime nvidia --gpus '"device=0"' \
+    -p 8000:8000 \
+    -e HF_TOKEN="<secret>" \
+    -v ~/.cache/huggingface:/root/.cache/huggingface \
+    vllm/vllm-openai:latest \
+    --model Qwen/Qwen2.5-1.5B-Instruct \
+    --enable-lora \
+    --lora-modules \
+        tool=minpeter/LoRA-corrupted-bfcl-1.5B-v1 \
+    --enable-auto-tool-choice \
+    --tool-call-parser hermes
+```
 
-More information needed
 
 ## Training procedure