Update README.md
Browse files
README.md
CHANGED
|
@@ -22,7 +22,7 @@ Use it directly or serve using [vLLM](https://docs.vllm.ai/en/latest/) for 62% V
|
|
| 22 |
Install vllm nightly and torchao nightly to get some recent changes:
|
| 23 |
```
|
| 24 |
pip install vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
|
| 25 |
-
pip install torchao
|
| 26 |
```
|
| 27 |
|
| 28 |
## Serving
|
|
@@ -55,8 +55,7 @@ this is expected be resolved in pytorch 2.8.
|
|
| 55 |
Install the required packages:
|
| 56 |
```Shell
|
| 57 |
pip install git+https://github.com/huggingface/transformers@main
|
| 58 |
-
pip install torchao
|
| 59 |
-
pip install torch
|
| 60 |
pip install accelerate
|
| 61 |
```
|
| 62 |
|
|
@@ -114,8 +113,7 @@ print("content:", content)
|
|
| 114 |
Install the required packages:
|
| 115 |
```Shell
|
| 116 |
pip install git+https://github.com/huggingface/transformers@main
|
| 117 |
-
pip install --pre torchao --index-url https://download.pytorch.org/whl/nightly/cu126
|
| 118 |
-
pip install torch
|
| 119 |
pip install accelerate
|
| 120 |
```
|
| 121 |
|
|
|
|
| 22 |
Install vllm nightly and torchao nightly to get some recent changes:
|
| 23 |
```
|
| 24 |
pip install vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
|
| 25 |
+
pip install --pre torchao torch --index-url https://download.pytorch.org/whl/nightly/cu126
|
| 26 |
```
|
| 27 |
|
| 28 |
## Serving
|
|
|
|
| 55 |
Install the required packages:
|
| 56 |
```Shell
|
| 57 |
pip install git+https://github.com/huggingface/transformers@main
|
| 58 |
+
pip install --pre torchao torch --index-url https://download.pytorch.org/whl/nightly/cu126
|
|
|
|
| 59 |
pip install accelerate
|
| 60 |
```
|
| 61 |
|
|
|
|
| 113 |
Install the required packages:
|
| 114 |
```Shell
|
| 115 |
pip install git+https://github.com/huggingface/transformers@main
|
| 116 |
+
pip install --pre torchao torch --index-url https://download.pytorch.org/whl/nightly/cu126
|
|
|
|
| 117 |
pip install accelerate
|
| 118 |
```
|
| 119 |
|