Hugging Face's logo

Spaces:
yusufs
/
llama32-3b-instruct
Paused

App Files Community
yusufs commited on
Commit
39a1959
·
verified ·
1 Parent(s): 7b16e9f

python3 -m vllm.entrypoints.openai.api_server

Browse files
Files changed (1) hide show
  1. Dockerfile +1 -1
Dockerfile CHANGED
@@ -16,7 +16,7 @@ FROM docker.io/vllm/vllm-openai:v0.10.0
16
 
17
  EXPOSE 7860
18
 
19
- CMD vllm serve \
20
  --model "meta-llama/Llama-3.2-3B-Instruct" \
21
  --task generate \
22
  --revision "0cb88a4f764b7a12671c53f0838cd831a0843b95" \
 
16
 
17
  EXPOSE 7860
18
 
19
+ CMD python3 -m vllm.entrypoints.openai.api_server \
20
  --model "meta-llama/Llama-3.2-3B-Instruct" \
21
  --task generate \
22
  --revision "0cb88a4f764b7a12671c53f0838cd831a0843b95" \