can use vllm deploy this model？
#8
by
tianyer
- opened
which vllm version can deploy this model? thanks.
tianyer
changed discussion title from
can use vllm deplot this model？
to can use vllm deploy this model？
I deploy it with vllm-v0.9.1，and it works
Here is the startup command