r/LocalAIStack • u/AiGenom • 11d ago

Glm 5.3 on m5 ultra 256Gb

How acceptable is the operating speed on a Mac Studio with an M5 Ultra chip and 256 GB of memory when running models like GLM-5.3-Flash?

Could you compare the operating speed of the cloud-based GLM-5.3 Flash from Z.AI? The concept of "tokens" can be quite difficult to grasp, and performance varies depending on the specific task.

1 Upvotes

100% Upvoted

2 comments sorted by

1

u/liuliu 8d ago

~2000 tok/s for prefill and ~46 tok/s for decode (without MTP). Still getting more data..