zamroni111
/

Meta-Llama-3.1-8B-Instruct-ONNX-DirectML-GenAI-INT4

Text Generation

Model card Files Files and versions

zamroni111 commited on Jan 29

Commit

673dd82

·

verified ·

1 Parent(s): 2603e42

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -62,7 +62,7 @@ python -m venv dmlgenai<br>
 dmlgenai\Scripts\activate.bat<br>
 pip install onnxruntime-genai-directml
-5. Use the onnxgenairun.py to get chat interface.<br>
 It is modified version of "https://github.com/microsoft/onnxruntime-genai/blob/main/examples/python/phi3-qa.py".<br>
 The modification makes the text output changes to new line after "., :, and ;" to make the output easier to be read.
@@ -71,7 +71,7 @@ cd this_onnx_model_directory<br>
 python onnxgenairun.py --help<br>
 python onnxgenairun.py -m . -v -g
-6. (Optional but recommended) Device specific optimization.<br>
 a. Open "dml-device-specific-optim.py" with text editor and change the file path accordingly.<br>
 b. Run the python script: python dml-device-specific-optim.py<br>
 c. Rename the original model.onnx to other file name and put and rename the optimized onnx file from step 5.b to model.onnx file.<br>

 dmlgenai\Scripts\activate.bat<br>
 pip install onnxruntime-genai-directml
+4. Use the onnxgenairun.py to get chat interface.<br>
 It is modified version of "https://github.com/microsoft/onnxruntime-genai/blob/main/examples/python/phi3-qa.py".<br>
 The modification makes the text output changes to new line after "., :, and ;" to make the output easier to be read.
 python onnxgenairun.py --help<br>
 python onnxgenairun.py -m . -v -g
+5. (Optional but recommended) Device specific optimization.<br>
 a. Open "dml-device-specific-optim.py" with text editor and change the file path accordingly.<br>
 b. Run the python script: python dml-device-specific-optim.py<br>
 c. Rename the original model.onnx to other file name and put and rename the optimized onnx file from step 5.b to model.onnx file.<br>