← Monday, October 12 deck

15Model release

Zhipu's Z.ai releases GLM Legal, a legal model built on GLM 5.3 Flash that it says matches frontier models on legal benchmarks

Introducing GLM-Legal Built on GLM-5.3-Flash, GLM-Legal matches frontier models on mainstream legal benchmarks. Designed for real legal workflows: contract review, evidence analysis, compliance, and more. Tech Blog: t.co/xOzFqKNyqD Apply for API Access: t.co/dKuoDRIKKz Try AutoClaw:

Bar chart titled LLM Performance on Harvey LAB showing all pass rates: GLM Legal 19.2, Kimi K3 12.9, Claude Fable 5 11.3, GLM 5.3 Flash 6.7, GPT 6 Astra 5.4
251 replies468 reposts5960 likes

Context

Why it matters

A small specialized model that rivals much larger general models on legal work would make AI cheaper for law firms and legal tech companies to run.

Z.ai is the international brand of Zhipu AI, the Chinese company behind the GLM model family. GLM Legal is available through an application for API access and is coming to AutoClaw, Z.ai's desktop agent platform. All benchmark results here are Z.ai's own and have not been independently verified.

Deep dive

On October 12, Z.ai posted that GLM Legal, built on GLM 5.3 Flash, matches frontier models on mainstream legal benchmarks and is designed for contract review, evidence analysis and compliance.

In its tech blog, Z.ai says GLM Legal scored a 19.2% all pass rate on Harvey LAB, a benchmark of real law firm workflows across 24 practice areas, an improvement of 12.5 percentage points over its base model. The chart in the post shows Kimi K3 at 12.9, Claude Fable 5 at 11.3 and GPT 6 Astra at 5.4 on the same test. Z.ai says the model matches top closed models on LegalBench and on PLawBench, a Chinese legal practice benchmark, despite a much smaller parameter footprint, though the blog does not give those scores.

The company says it trained the model with extra legal data in a mid training stage, then with reinforcement learning across tens of thousands of realistic legal environments, while improving the agent harness alongside the model. Its examples include contract review, analysis of 40 documents from a software dispute and privacy planning for a launch in Singapore, Malaysia and Indonesia.

Z.ai says GLM Legal is in beta for law firms, legal tech companies, in house teams and independent practitioners, and did not publish pricing or model weights.

What to expect next

Watch for independent results on Harvey LAB and LegalBench, and whether Z.ai publishes the LegalBench and PLawBench numbers behind its parity claim.

Also watch who joins the beta, whether the model reaches AutoClaw on schedule, and whether Z.ai releases weights as it has for other GLM models, which would let firms run it on their own servers. Independent tests by legal tech firms would be the clearest check on the parity claim.