GLM-4.5-MLX-3bit / README.md
monirmamoun's picture
Add files using upload-large-folder tool
17a8d77 verified
metadata
language:
  - en
  - zh
library_name: mlx
license: mit
pipeline_tag: text-generation
base_model: zai-org/GLM-4.5
tags:
  - GLM-4.5

MOPO Labs presents what to our knowledge is the first quantized GLM-4.5 with a 3-bit MLX format quantization that allows the original 355gb model to work on a 192GB Mac using LM Studio and other MLX compatible tools. Note this is a research build intended to learn more about the differences between the GLM-4.5 quantized lower versus the GLM-4.5 Air model; If you discover good tips, kindly share with monir@mopo.life or on huggingface.