jerryzh168 commited on
Commit
4151644
·
verified ·
1 Parent(s): c6d359d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -5
README.md CHANGED
@@ -25,7 +25,7 @@ This repository hosts the **Phi4-mini-instruct** model quantized with [torchao](
25
  Install vllm nightly and torchao nightly to get some recent changes:
26
  ```
27
  pip install vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
28
- pip install --pre torchao --index-url https://download.pytorch.org/whl/nightly/cu126
29
  ```
30
 
31
  ## Code Example
@@ -77,8 +77,7 @@ vllm serve pytorch/Phi-4-mini-instruct-INT4 --tokenizer microsoft/Phi-4-mini-ins
77
  Install the required packages:
78
  ```Shell
79
  pip install git+https://github.com/huggingface/transformers@main
80
- pip install --pre torchao --index-url https://download.pytorch.org/whl/nightly/cu126
81
- pip install --pre torch --index-url https://download.pytorch.org/whl/nightly/cu126
82
  pip install accelerate
83
  ```
84
 
@@ -128,8 +127,7 @@ print(output[0]['generated_text'])
128
  Install the required packages:
129
  ```Shell
130
  pip install git+https://github.com/huggingface/transformers@main
131
- pip install --pre torchao --index-url https://download.pytorch.org/whl/nightly/cu126
132
- pip install --pre torch --index-url https://download.pytorch.org/whl/nightly/cu126
133
  pip install accelerate
134
  ```
135
 
 
25
  Install vllm nightly and torchao nightly to get some recent changes:
26
  ```
27
  pip install vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
28
+ pip install --pre torchao torch --index-url https://download.pytorch.org/whl/nightly/cu126
29
  ```
30
 
31
  ## Code Example
 
77
  Install the required packages:
78
  ```Shell
79
  pip install git+https://github.com/huggingface/transformers@main
80
+ pip install --pre torchao torch --index-url https://download.pytorch.org/whl/nightly/cu126
 
81
  pip install accelerate
82
  ```
83
 
 
127
  Install the required packages:
128
  ```Shell
129
  pip install git+https://github.com/huggingface/transformers@main
130
+ pip install --pre torchao torch --index-url https://download.pytorch.org/whl/nightly/cu126
 
131
  pip install accelerate
132
  ```
133