GLM-4.7-6bit MLX vs MiniMax-M2.1-6bit MLX Benchmark Results on M3 Ultra 512GB

This article presents benchmark results comparing GLM-4.7-6bit MLX and MiniMax-M2.1-6bit MLX models on an Apple M3 Ultra with 512GB of RAM. The benchmarks focus on prompt processing speed, token generation speed, and memory usage across different context sizes (0.5k to 64k). The results indicate that MiniMax-M2.1 outperforms GLM-4.7 in both prompt processing and token generation speed. The article also touches upon the trade-offs between 4-bit and 6-bit quantization, noting that while 4-bit offers lower memory usage, 6-bit provides similar performance. The user expresses a preference for MiniMax-M2.1 based on the benchmark results. The data provides valuable insights for users choosing between these models for local LLM deployment on Apple silicon.

• •MiniMax-M2.1 outperforms GLM-4.7 in prompt processing and token generation on M3 Ultra.
• •6-bit quantization offers similar performance to 4-bit but with higher memory usage.
• •Context size impacts performance, with both models showing a decrease in tokens/second as context size increases.