Hugging Face's logo

zai-org
/
GLM-4.6-FP8

Text Generation
Transformers
Safetensors
English
Chinese
glm4_moe
conversational
compressed-tensors
Model card Files
xet
Community
3

Keep getting error report like this.

#2
by alexchenyu - opened
Discussion
alexchenyu

(APIServer pid=1361915) ERROR 10-06 17:11:10 [glm4_moe_tool_parser.py:112] Failed to extract tool call spec
(APIServer pid=1361915) ERROR 10-06 17:11:10 [glm4_moe_tool_parser.py:112] Traceback (most recent call last):
(APIServer pid=1361915) ERROR 10-06 17:11:10 [glm4_moe_tool_parser.py:112] File "/home/alex/vllm/lib/python3.10/site-packages/vllm/entrypoints/openai/tool_parsers/glm4_moe_tool_parser.py", line 110, in extract_tool_calls
(APIServer pid=1361915) ERROR 10-06 17:11:10 [glm4_moe_tool_parser.py:112] name=tc_name, arguments=json.dumps(arg_dct))))
(APIServer pid=1361915) ERROR 10-06 17:11:10 [glm4_moe_tool_parser.py:112] File "/usr/lib/python3.10/json/init.py", line 231, in dumps
(APIServer pid=1361915) ERROR 10-06 17:11:10 [glm4_moe_tool_parser.py:112] return _default_encoder.encode(obj)
(APIServer pid=1361915) ERROR 10-06 17:11:10 [glm4_moe_tool_parser.py:112] File "/usr/lib/python3.10/json/encoder.py", line 199, in encode
(APIServer pid=1361915) ERROR 10-06 17:11:10 [glm4_moe_tool_parser.py:112] chunks = self.iterencode(o, _one_shot=True)
(APIServer pid=1361915) ERROR 10-06 17:11:10 [glm4_moe_tool_parser.py:112] File "/usr/lib/python3.10/json/encoder.py", line 257, in iterencode
(APIServer pid=1361915) ERROR 10-06 17:11:10 [glm4_moe_tool_parser.py:112] return _iterencode(o, 0)
(APIServer pid=1361915) ERROR 10-06 17:11:10 [glm4_moe_tool_parser.py:112] File "/home/alex/vllm/lib/python3.10/site-packages/frozendict/init.py", line 32, in default
(APIServer pid=1361915) ERROR 10-06 17:11:10 [glm4_moe_tool_parser.py:112] return BaseJsonEncoder.default(
(APIServer pid=1361915) ERROR 10-06 17:11:10 [glm4_moe_tool_parser.py:112] File "/usr/lib/python3.10/json/encoder.py", line 179, in default
(APIServer pid=1361915) ERROR 10-06 17:11:10 [glm4_moe_tool_parser.py:112] raise TypeError(f'Object of type {o.class.name} '
(APIServer pid=1361915) ERROR 10-06 17:11:10 [glm4_moe_tool_parser.py:112] TypeError: Object of type set is not JSON serializable
(APIServer pid=1361915) WARNING 10-06 17:11:10 [glm4_moe_tool_parser.py:161] Failed to extract any tool calls.
(APIServer pid=1361915) ERROR 10-06 17:11:10 [glm4_moe_tool_parser.py:112] Failed to extract tool call spec
(APIServer pid=1361915) ERROR 10-06 17:11:10 [glm4_moe_tool_parser.py:112] Traceback (most recent call last):
(APIServer pid=1361915) ERROR 10-06 17:11:10 [glm4_moe_tool_parser.py:112] File "/home/alex/vllm/lib/python3.10/site-packages/vllm/entrypoints/openai/tool_parsers/glm4_moe_tool_parser.py", line 110, in extract_tool_calls

Sign up or log in to comment