Update README.md
Browse files
README.md
CHANGED
@@ -141,7 +141,8 @@ Expected output:
|
|
141 |
|
142 |
```bash
|
143 |
# Launch the vLLM server
|
144 |
-
|
|
|
145 |
```
|
146 |
|
147 |
```python
|
|
|
141 |
|
142 |
```bash
|
143 |
# Launch the vLLM server
|
144 |
+
# If run out of VRAM, try add --max_model_len 2048
|
145 |
+
vllm serve model/AgentCPM-GUI --served-model-name AgentCPM-GUI --tensor_parallel_size 1 --trust-remote-code --limit-mm-per-prompt image=10
|
146 |
```
|
147 |
|
148 |
```python
|