Spaces:

yusufs
/

llama32-3b-instruct

Paused

yusufs commited on 18 days ago

Commit

94a34ed

verified ·

1 Parent(s): 89c17e2

Update Dockerfile

Files changed (1) hide show

Dockerfile CHANGED Viewed

@@ -69,7 +69,8 @@ EXPOSE 7860
 #   --disable-log-requests \
 #   --trust-remote-code
-CMD --model "meta-llama/Llama-3.2-3B-Instruct" \
   --task generate \
   --revision "0cb88a4f764b7a12671c53f0838cd831a0843b95" \
   --code-revision "0cb88a4f764b7a12671c53f0838cd831a0843b95" \

 #   --disable-log-requests \
 #   --trust-remote-code
+CMD python -m vllm.entrypoints.openai.api_server \  \
+  --model "meta-llama/Llama-3.2-3B-Instruct" \
   --task generate \
   --revision "0cb88a4f764b7a12671c53f0838cd831a0843b95" \
   --code-revision "0cb88a4f764b7a12671c53f0838cd831a0843b95" \