Hiding Thinking Process

#25
by Xzendor7 - opened

Is there a command or procedure to hide the thinking process from being output to the screen?

That's just a function of your chat UI.

Seed-OSS does use 'nonstandard' thinking tokens (eg most models use <think> instead), but it should be easy to support if you can modify the template.

@Downtown-Case 不好意思打扰了,没太懂
是要修改 Seed-OSS-36B-Instruct-AWQ/chat_template.jinja 这个文件吗?
我理解是不是要修改 vllm或者sglang的源码,支持seed:think ,才能实现思考过程与结果分离

Sign up or log in to comment