zhong-zhang commited on
Commit
433b33f
·
verified ·
1 Parent(s): a72ead9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -141,7 +141,8 @@ Expected output:
141
 
142
  ```bash
143
  # Launch the vLLM server
144
- vllm serve model/AgentCPM-GUI --served-model-name AgentCPM-GUI --tensor_parallel_size 1 --trust-remote-code
 
145
  ```
146
 
147
  ```python
 
141
 
142
  ```bash
143
  # Launch the vLLM server
144
+ # If run out of VRAM, try add --max_model_len 2048
145
+ vllm serve model/AgentCPM-GUI --served-model-name AgentCPM-GUI --tensor_parallel_size 1 --trust-remote-code --limit-mm-per-prompt image=10
146
  ```
147
 
148
  ```python