Granite 4.0

Granite-4.0-1B-Base

by IBM watsonx · Current open-weight model

IBM’s Granite-4.0-1B-Base is a compact Apache 2.0 language model with a 128K context window, multilingual text generation, fill-in-the-middle code completion, and support for local deployment and fine-tuning. It is designed for efficient self-hosted inference, but its non-aligned base-model status means production applications need additional safety, validation, and monitoring controls.

Text Reasoning Coding
Granite-4.0-1B-Base is IBM’s compact open-weight language model for developers who need local, offline, or edge inference rather than a managed token-based API. It provides a 128K-token context window, multilingual text generation, fill-in-the-middle code completion, and compatibility with Transformers, vLLM, SGLang, Docker, and quantized runtimes. Its main trade-off is that the base model is not safety-aligned and is less suitable for demanding reasoning or safety-critical applications without additional controls.
Outputs

What Granite-4.0-1B-Base can produce

Text
Inputs

What it can understand

Text
Capabilities

Support features

Fine-tuning
Model profile

Performance characteristics

58/10 Reasoning
68/10 Coding
90/10 Speed
95/10 Cost efficiency
Specifications

Technical details

Family Granite 4.0
Type Lightweight
Context window 131K tokens
Max output tokens tokens
Release date 2025-10-28
Status Current open-weight model
Knowledge cutoff notes

No authoritative knowledge-cutoff date was published for this exact model in the reviewed model card or configuration documentation.

Model notes

Granite-4.0-1B-Base is an Apache 2.0-licensed downloadable checkpoint in IBM's Granite 4.0 Nano family. The official model card describes a lightweight decoder-only language model trained on approximately 15 trillion tokens and supporting English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, and Chinese. IBM's architecture table lists a 128K sequence length and approximately 1.6B parameters for the dense 1B configuration. The model supports fill-in-the-middle code completion. It can be loaded with Transformers and served through open-source runtimes including vLLM and SGLang. No IBM-hosted input or output token price was identified for this downloadable model. Reasoning, coding, speed, and cost scores are editorial estimates based on the model's compact architecture, stated use cases, and published benchmark results; they are not IBM-provided ratings. The model card states that the base model has not undergone safety alignment.

Model guide

Granite-4.0-1B-Base: IBM’s Compact Open-Weight Model for Local and Edge AI

Granite-4.0-1B-Base is an Apache 2.0-licensed, lightweight decoder-only language model from IBM’s Granite 4.0 Nano family. It is designed for efficient multilingual text generation, fill-in-the-middle code completion, fine-tuning, and self-hosted deployment on local or resource-constrained hardware.

What is Granite-4.0-1B-Base?

Granite-4.0-1B-Base is a lightweight, decoder-only language model provided by IBM. It belongs to IBM’s Granite 4.0 Nano family of compact open-weight models and was released on October 28, 2025, according to the supplied model information. The checkpoint is distributed under the Apache 2.0 license, allowing developers to download it and deploy it in their own environments instead of relying exclusively on a proprietary hosted service.

The model is intended for text-to-text workloads. Typical applications include summarization, question answering, classification, information extraction, multilingual generation, code completion, and task-specific fine-tuning. Its relatively small footprint makes it relevant when inference speed, privacy, offline operation, or deployment close to a device matters more than the maximum reasoning ability available from a much larger model.

The “1B” name describes the model’s family configuration, but IBM’s architecture information lists approximately 1.6 billion active parameters for this dense configuration. That distinction is useful when estimating memory and hardware requirements: the model is compact compared with large language models, but it is not literally limited to one billion parameters.

Where it fits in IBM’s model lineup

Granite-4.0-1B-Base is the base, downloadable member of IBM’s Granite 4.0 Nano family covered by this page. A base model is intended to provide general language-generation capabilities and a foundation for further application-specific work. It is not presented as a finished safety-aligned assistant or as a managed IBM API endpoint.

This positioning makes the model different from a larger hosted model optimized for broad, complex reasoning. Granite-4.0-1B-Base prioritizes compact deployment and flexibility. Developers can fine-tune it, quantize it, integrate it into a local application, or serve it through open-source inference infrastructure. The trade-off is that users are responsible for more of the deployment, evaluation, safety, and operational work.

Technical specifications and context capacity

The official configuration information supplied for the model specifies a maximum sequence length of 131,072 tokens, commonly described as a 128K-token context window. Context length is the amount of text the model can process within one request, including the prompt and generated continuation. A long context can be useful for document summarization, code repositories, multi-document extraction, or conversations that need substantial preceding material.

The architecture uses 40 attention layers, grouped-query attention, RMSNorm, SwiGLU activations, and shared input and output embeddings. The model is stored in bfloat16 format and has a vocabulary of approximately 100,000 tokens. These are verified configuration or model-card details rather than independent performance claims.

No authoritative maximum output-token value was identified in the supplied research. The practical output limit can therefore depend on the serving runtime, available memory, the context already consumed by the prompt, and any generation settings imposed by the application.

SpecificationDetails
ProviderIBM
Model familyGranite 4.0 Nano
Model typeLightweight decoder-only language model
LicenseApache 2.0
Context length131,072 tokens, described as 128K
Approximate active parameters1.6 billion for the dense 1B configuration
Input and outputText input and text output
Maximum output tokensNot identified in the supplied research

Language and coding capabilities

IBM’s model information lists support for English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, and Chinese. This makes Granite-4.0-1B-Base suitable for multilingual generation and language-specific applications, although the supplied research does not establish that quality is equal across all listed languages.

The model also supports fill-in-the-middle code completion. In this format, the application supplies code before and after a missing section, and the model generates a continuation that fits between the prefix and suffix. This is useful for editor integrations, code repair experiments, and generating missing functions or statements. The model can also be fine-tuned for specialized coding or domain tasks, but the research does not provide a general coding benchmark or guarantee production-level software reliability.

Editorial scores supplied for this listing rate coding capability at 68 out of 100, reasoning at 58, speed at 90, and cost efficiency at 95. These are subjective editorial estimates based on the compact architecture, stated use cases, and available model information. They are not IBM-published scores and should not be treated as benchmark results.

Deployment and integration options

Granite-4.0-1B-Base can be loaded with the Hugging Face Transformers library. The supplied documentation also identifies open-source serving options including vLLM and SGLang, along with Docker-oriented deployment paths. Quantized variants or compatible conversion workflows are associated with tools such as llama.cpp, Ollama, and LM Studio.

This range of deployment choices is one of the model’s main practical advantages. A team can run it on infrastructure it controls, place inference near an application or device, and avoid sending sensitive prompts to a third-party hosted endpoint. Local deployment may also provide predictable costs when usage is high and suitable hardware is already available.

Self-hosting does not mean that inference is free. The operator still needs computing hardware, storage, monitoring, software maintenance, and safeguards. Performance will vary according to the selected precision, quantization method, runtime, batch size, and hardware. The supplied research does not identify a single hardware requirement or guaranteed tokens-per-second figure.

Pricing and API availability

There is no model-specific IBM input-token or output-token price identified for Granite-4.0-1B-Base. The reason is that this item is supplied as a downloadable open-weight checkpoint rather than as a documented metered IBM-hosted endpoint. Users generally incur the costs of their own hardware, cloud infrastructure, or third-party inference service instead.

This pricing model can be attractive for offline applications, privacy-sensitive workloads, and deployments with steady high-volume usage. It is less convenient for teams that want a fully managed API with centralized billing, automatic scaling, provider-operated uptime, and a ready-made safety layer. Any hosted service that offers this checkpoint may set its own prices, but such pricing is not specified in the supplied research.

Modalities, tools, and structured output

Granite-4.0-1B-Base is a text model. It accepts text and produces text; it does not natively accept images, audio, or video, and it does not natively generate those media types. Applications requiring vision, speech, image creation, or video processing need a different model or an additional model pipeline.

Native tool use, function calling, web search, and action execution are not documented as intrinsic capabilities of this checkpoint. An application can potentially connect the model to tools through an external orchestration layer, but that does not make tool support a verified built-in model feature. Likewise, structured output and JSON-mode behavior were not identified as intrinsic capabilities in the supplied research. Developers who need reliable schemas must validate and constrain generated text at the application or serving layer.

Limitations and safety considerations

The most important limitation is that the base model has not undergone safety alignment, according to IBM’s model information. It may produce biased, unsafe, misleading, or otherwise problematic content. It should not be used as a production safety filter or as the sole control for high-impact decisions.

Its compact size also creates a capability trade-off. Smaller models can be faster and cheaper to run, but they may be less reliable on difficult reasoning, ambiguous instructions, complex planning, and tasks requiring extensive world knowledge. The supplied research does not provide a verified knowledge-cutoff date for this exact checkpoint, so users should not assume that it contains current information. It also has no documented native web-search capability.

For production use, developers should evaluate the model on representative prompts, add input and output validation, test for unwanted memorization and bias, and keep humans involved in safety-critical workflows. A large context window does not by itself guarantee accurate retrieval or faithful summarization of everything placed in that context.

When to choose Granite-4.0-1B-Base

Choose Granite-4.0-1B-Base when the priority is a compact, multilingual text model that can be downloaded, customized, and run under your control. It is a sensible candidate for local assistants, offline automation, embedded applications, privacy-sensitive text processing, edge deployments, fill-in-the-middle code completion, and fine-tuned classifiers or extractors.

  • Choose it for local control: prompts and outputs can remain within infrastructure managed by the deploying organization.
  • Choose it for speed and resource efficiency: its compact architecture is better suited to constrained deployments than much larger language models.
  • Choose it for customization: the Apache 2.0 license and open checkpoint support fine-tuning and application-specific experimentation.
  • Choose another type of model for advanced reasoning: a larger reasoning-oriented or frontier model may be more appropriate for difficult analysis, planning, and complex multi-step tasks.
  • Choose another model for media: image, audio, or video input and output require models with those native modalities.
  • Choose a managed API for operational simplicity: a hosted service may be preferable when automatic scaling, provider-managed operations, and built-in platform features matter more than self-hosting.

Overall, Granite-4.0-1B-Base is best understood as a flexible foundation for efficient, self-managed text generation rather than a complete hosted assistant. Its value comes from the combination of open licensing, multilingual support, a long context window, code-completion capability, and deployment flexibility. Those benefits must be balanced against the lack of native media, unspecified output limits, absence of a documented IBM token price, and the safety and quality responsibilities that come with using a non-aligned base model.


Answers to Frequently Asked Questions

What are the main limitations of Granite-4.0-1B-Base?
Granite-4.0-1B-Base is an unaligned base model and may produce biased, unsafe, misleading, or otherwise problematic content. It does not natively support images, audio, video, web search, or documented built-in tool use and structured-output guarantees. Developers should validate inputs and outputs, evaluate it on representative tasks, and use human oversight for safety-critical applications.
Which languages and coding capabilities does Granite-4.0-1B-Base support?
IBM’s model information lists English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, and Chinese. The model also supports fill-in-the-middle code completion, in which it generates code for a missing section between a provided prefix and suffix. The available information does not establish equal quality across all languages or guarantee production-level coding reliability.
Can Granite-4.0-1B-Base run locally or on edge devices?
Yes. Granite-4.0-1B-Base can be downloaded and deployed under the Apache 2.0 license using tools such as Hugging Face Transformers, vLLM, SGLang, Docker, llama.cpp, Ollama, and LM Studio. Actual performance and hardware requirements depend on precision, quantization, runtime, batch size, and the available hardware.
What is Granite-4.0-1B-Base?
Granite-4.0-1B-Base is a lightweight, decoder-only language model from IBM’s Granite 4.0 Nano family. It is an open-weight text-to-text model designed for tasks such as summarization, question answering, classification, information extraction, multilingual generation, code completion, and fine-tuning.
What are the main technical specifications of Granite-4.0-1B-Base?
The model has approximately 1.6 billion active parameters in its dense 1B configuration and supports a maximum sequence length of 131,072 tokens, commonly described as a 128K context window. It uses 40 attention layers, grouped-query attention, RMSNorm, SwiGLU activations, shared input and output embeddings, bfloat16 storage, and a vocabulary of approximately 100,000 tokens.


Sources 4
AI Provider

About IBM watsonx