Spaces:

rieon
/

deepcoder-v1

Sleeping

rieon commited on Apr 24

Commit

5b1cb20

1 Parent(s): 4006b98

fix

Files changed (1) hide show

app.py CHANGED Viewed

@@ -81,7 +81,7 @@ def respond(
     inputs = tokenizer(prompt, return_tensors="pt").to(device)
     model.generate(**inputs,
                    streamer=streamer,
-                   max_new_tokens=max_new_tokens,
                    temperature=temperature,
                    top_p=top_p)

     inputs = tokenizer(prompt, return_tensors="pt").to(device)
     model.generate(**inputs,
                    streamer=streamer,
+                   max_new_tokens=max_tokens,
                    temperature=temperature,
                    top_p=top_p)