rocca/GLM-4.5-compressed-tensors-w4a16-g128-v1

Warning: This has not been extensively tested. Accuracy may not be optimal.

• https://github.com/zai-org/GLM-4.5

• https://huggingface.co/zai-org/GLM-4.5

• https://github.com/vllm-project/llm-compressor

See recipe.yaml for the quantization recipe.