GLM-4.6

GLM-4.6-REAP-252B-A32B

by Cerebras · Current open-weight checkpoint

Cerebras's GLM-4.6-REAP-252B-A32B is an open-weight, 30%-pruned derivative of Z.ai's GLM-4.6. The BF16 MoE checkpoint has 252B total parameters, 32B active parameters, a 202,752-token context window, MIT licensing, and support for coding, reasoning, tool calling, and self-hosted agentic deployments.

Text Reasoning Coding
GLM-4.6-REAP-252B-A32B is an open-weight sparse mixture-of-experts language model from Cerebras. It applies Router-weighted Expert Activation Pruning, or REAP, to Z.ai's GLM-4.6, removing relatively less useful experts rather than merging them. The resulting BF16 checkpoint is smaller than the original 355B-parameter model while preserving its 32B active-parameter configuration. It is primarily aimed at self-hosted coding assistants, repository-scale software work, research, tool calling, and agentic workflows—not at users seeking a separately priced hosted API.
Outputs

What GLM-4.6-REAP-252B-A32B can produce

Text
Inputs

What it can understand

Text
Capabilities

Support features

Tool use Streaming
Model profile

Performance characteristics

8/10 Reasoning
9/10 Coding
7/10 Speed
8/10 Cost efficiency
Specifications

Technical details

Family GLM-4.6
Type Reasoning
Context window 203K tokens
Max output tokens tokens
Release date 2025-10-24
Status Current open-weight checkpoint
Knowledge cutoff notes

No direct authoritative knowledge-cutoff date is published for this exact REAP checkpoint. The model inherits the GLM-4.6 model lineage but its knowledge cutoff should not be inferred from the release date.

Model notes

Cerebras checkpoint derived from zai-org/GLM-4.6 using Router-weighted Expert Activation Pruning. The BF16 model has 252B total parameters, 32B active parameters per token, 112 experts, 8 activated experts per token, 92 layers, and 30% expert pruning from the original 160-expert configuration. The model card reports a 202,752-token context length and MIT licensing. It is intended for local or self-managed inference and has no separately documented Cerebras hosted API price. The separate FP8 checkpoint is a materially different quantized representation. Reasoning, coding, speed, and cost scores are editorial estimates based on the model's GLM-4.6 lineage, documented coding and tool-use positioning, sparse architecture, and reduced parameter count; they are not provider-published benchmark scores.

COST

Pricing

Input No official hosted API price; self-hosted checkpoint
Output No official hosted API price; self-hosted checkpoint
Model guide

GLM-4.6-REAP-252B-A32B: A Compressed MoE Model for Self-Hosted Coding and Agents

GLM-4.6-REAP-252B-A32B is Cerebras's open-weight, 30%-pruned derivative of Z.ai's GLM-4.6. It reduces the original model from 355B to 252B total parameters while retaining 32B active parameters per token, a 202,752-token context window, coding and reasoning capabilities, tool calling, and support for agentic software workflows.

What is GLM-4.6-REAP-252B-A32B?

GLM-4.6-REAP-252B-A32B is Cerebras's compressed version of Z.ai's GLM-4.6. It is a sparse mixture-of-experts, or MoE, causal language model distributed as an open-weight checkpoint on Hugging Face. The model was published in October 2025 and is listed in Cerebras's current Hugging Face catalog.

Unlike a conventional dense model, an MoE model contains multiple expert subnetworks but activates only a subset for each token. In this checkpoint, 32B parameters are active per token even though the model contains 252B parameters in total. This can reduce computation per token compared with activating the entire parameter set, but it does not eliminate the memory required to store the full model.

The checkpoint is intended for local or self-managed inference. It is not documented as a separately priced Cerebras hosted API model. Users who deploy it generally need to provide their own multi-GPU infrastructure or use a third-party serving environment.

How REAP compresses the original model

Cerebras created the checkpoint with Router-weighted Expert Activation Pruning, abbreviated REAP. The method examines router gate values and expert activation norms to estimate which experts contribute less to the model's output. It then removes selected experts while preserving the router's ability to choose among the remaining experts.

The result has 112 experts, compared with 160 in the original GLM-4.6 configuration, and activates eight experts for each token. Cerebras describes this as 30% expert pruning, reducing the total parameter count from 355B to 252B. REAP is different from expert merging: multiple experts are not collapsed into one combined expert.

This distinction matters in practice. The model is materially smaller than the full GLM-4.6 checkpoint, but 252B total parameters is still a very large deployment target. The reduction helps with memory and infrastructure requirements relative to the uncompressed model; it does not make the checkpoint a lightweight single-GPU model.

Capabilities and context length

GLM-4.6-REAP-252B-A32B is designed for text generation, reasoning, software development, repository-scale coding, agentic workflows, and function or tool calling. The model card presents it as retaining the core capabilities of GLM-4.6, including code generation, agentic coding, and tool use.

Its documented context length is 202,752 tokens. A context window this large is useful for tasks such as examining large codebases, supplying long technical specifications, reviewing extensive logs, or maintaining substantial conversation and tool history. The supplied documentation does not specify a maximum output-token limit for this exact REAP checkpoint, so an exact completion limit should not be assumed.

The model is text-only. It accepts text input and produces text output, with tool calls available as part of an external function-calling or agent framework. There is no supplied evidence that the checkpoint directly accepts images, audio, or video, or that it directly generates those media types.

Coding, reasoning, and tool use

Coding is one of the clearest intended uses for this checkpoint. Its GLM-4.6 lineage is positioned for code generation, agentic coding, and repository-level software tasks. In practical terms, suitable workloads include generating or refactoring code, investigating a multi-file project, drafting implementation plans, interpreting error logs, and producing tool calls that let an agent inspect or modify a development environment.

The model can also support reasoning-heavy text tasks and multi-step agent workflows. However, the supplied research does not provide standardized benchmark results for this specific REAP checkpoint. Its reasoning and coding ratings should therefore be treated as editorial estimates rather than provider-published scores. The documented facts are its model lineage, architecture, context length, tool-use positioning, and intended deployment scenarios.

Tool calling is not the same as built-in web browsing. The model can generate function or tool calls when connected to a compatible orchestration layer, but whether an application can search the web, access files, run code, or use other services depends on the tools and agent framework surrounding the checkpoint. Web-search support for the model itself is not verified in the supplied research.

Deployment and hardware trade-offs

The BF16 checkpoint can be loaded with Transformers and served with compatible systems such as vLLM and SGLang. Cerebras recommends vLLM configurations using tensor parallelism, expert parallelism, and the GLM tool-call parser. The model card states that it works with vanilla vLLM without source modifications or custom patches.

Tensor parallelism distributes model weights across multiple GPUs, while expert parallelism distributes the MoE experts. These techniques are relevant because the checkpoint's total size remains substantial even though only 32B parameters are active for each token. Actual hardware requirements depend on memory capacity, serving settings, concurrency, context length, and numerical format.

The available FP8 checkpoint can reduce memory requirements compared with BF16, but it is a separate quantized representation rather than the same artifact. Quantization may affect quality and performance, so users should evaluate it against their workload instead of treating it as an automatic replacement for the BF16 version.

In speed and cost terms, the pruned architecture offers a more economical deployment target than the original 355B-parameter GLM-4.6, especially when total model storage and infrastructure scale are limiting factors. It is still not an inexpensive model to operate. The supplied research does not provide a hosted latency figure, throughput benchmark, or per-token infrastructure cost.

Pricing, license, and availability

No official per-token hosted API price is listed for GLM-4.6-REAP-252B-A32B. Cerebras presents it primarily as a downloadable model, so the practical cost is the infrastructure required to download, store, and serve the checkpoint. This differs from a managed inference endpoint, where the provider normally publishes usage pricing and handles the serving hardware.

The checkpoint is available under the MIT license according to the supplied model documentation. Users should still review the model repository and applicable usage terms before deploying it in a particular commercial or regulated environment.

Its official model repository is hosted at Cerebras's Hugging Face page for GLM-4.6-REAP-252B-A32B. The model is distinct from the full GLM-4.6 model made available through Cerebras's inference products; the REAP checkpoint is chiefly documented for local or self-managed use.

Main strengths and limitations

Strengths

  • Lower total size than the source model: REAP reduces the original 355B-parameter configuration to 252B parameters while retaining 32B active parameters per token.
  • Strong fit for software workflows: The model is positioned for coding, agentic coding, repository-scale tasks, reasoning, and tool calling.
  • Large context: The documented 202,752-token window supports long code, documentation, logs, and agent histories.
  • Self-hosting flexibility: Open weights, an MIT license, and compatibility with common inference systems give teams control over deployment.
  • Compression without expert merging: The REAP approach removes selected experts while preserving the remaining routing structure.

Limitations

  • Still a very large model: A 252B BF16 checkpoint requires substantial multi-GPU memory and is not suited to lightweight single-GPU deployment.
  • No documented hosted price: Users looking for a simple usage-based API for this exact checkpoint will not find an official Cerebras price in the supplied documentation.
  • No verified maximum output limit: The context length is documented, but the maximum completion size is not.
  • Text-only operation: It is not documented for direct image, audio, or video input or output.
  • Tool access requires integration: Function calling does not itself provide web search, code execution, file access, or other external capabilities.
  • Limited checkpoint-specific benchmarking in the supplied material: Coding, reasoning, speed, and cost scores are editorial estimates rather than provider-published benchmark results.

When to choose GLM-4.6-REAP-252B-A32B

Choose this model when you need the GLM-4.6 family for coding or agentic work but want a smaller deployment target than the original 355B-parameter checkpoint. It is particularly appropriate for organizations that can operate a multi-GPU serving stack and value control over model placement, data handling, inference configuration, and tool integration.

The model is a reasonable candidate for self-hosted coding assistants, repository analysis, autonomous software agents, research into MoE compression, long-context technical work, and applications that need function calling without relying on a separately managed hosted endpoint.

A smaller dense or sparse model may be more appropriate when fast startup, low hardware cost, or single-GPU operation matters more than the capabilities associated with this model's scale. A managed hosted model may be preferable when the priority is predictable per-token billing, provider-operated infrastructure, or a simple API. The full GLM-4.6 checkpoint may be worth considering when maximum fidelity to the original model is more important than the memory savings from REAP.

Bottom line

GLM-4.6-REAP-252B-A32B is best understood as a compressed, self-hosted GLM-4.6 derivative rather than a low-cost hosted service. Its 30% expert pruning lowers the total parameter count to 252B while preserving a 32B active-parameter MoE design, a roughly 202K-token context window, coding capabilities, reasoning-oriented use, and tool calling. The trade-off is that the checkpoint remains operationally demanding and has no separately documented hosted API price or exact maximum output limit.


Answers to Frequently Asked Questions

Does GLM-4.6-REAP-252B-A32B have an official hosted API price?
No separately documented hosted API price is listed for GLM-4.6-REAP-252B-A32B. It is primarily distributed as a downloadable checkpoint for local or self-managed deployment, so users generally pay for the infrastructure needed to store and serve it.
What hardware is required to run GLM-4.6-REAP-252B-A32B?
The model requires substantial multi-GPU infrastructure because it contains 252B total parameters, even though only 32B are active for each token. BF16 deployment can use Transformers, vLLM, or SGLang with tensor and expert parallelism. An FP8 version can reduce memory requirements, but actual needs depend on GPU capacity, context length, concurrency, and serving configuration.
How does REAP reduce the size of GLM-4.6?
Router-weighted Expert Activation Pruning, or REAP, removes experts that contribute less to model outputs based on router gate values and expert activation norms. It reduces the configuration from 160 to 112 experts and lowers the total parameter count from 355B to 252B without merging multiple experts into one.
What can GLM-4.6-REAP-252B-A32B be used for?
The model is intended for code generation, software development, repository-scale coding, reasoning-heavy text tasks, agentic workflows, and function or tool calling. It supports a documented context length of 202,752 tokens, making it suitable for large codebases, technical specifications, logs, and extended tool histories.
What is GLM-4.6-REAP-252B-A32B?
GLM-4.6-REAP-252B-A32B is Cerebras's compressed, open-weight version of Z.ai's GLM-4.6. It is a sparse mixture-of-experts model with 252B total parameters and 32B active parameters per token, designed primarily for self-hosted inference.


Sources 5
AI Provider

About Cerebras