Pharia-1-LLM-7B

Pharia-1-LLM-7B-control-aligned

by Aleph Alpha · Available open-weight release; safety-aligned variant

A 7-billion-parameter multilingual causal language model from Aleph Alpha Research, Pharia-1-LLM-7B-control-aligned adds Direct Preference Optimization-based safety and helpfulness alignment to the Pharia-1-LLM-7B-control model. It supports text generation and related NLP tasks across several European languages, uses an 8,192-token context window, and is available for non-commercial research and educational use through a public open-weight release.

Text Reasoning Coding
Pharia-1-LLM-7B-control-aligned is a downloadable multilingual foundation model released by Aleph Alpha Research on August 26, 2024. It supports text generation, classification, summarization, question answering, and labeling, and is designed for applications that need European-language coverage, a relatively compact model, and additional alignment for safer instruction-following.
Outputs

What Pharia-1-LLM-7B-control-aligned can produce

Text
Inputs

What it can understand

Text
Capabilities

Supported features

Fine-tuning
Model profile

Performance characteristics

4/10 Reasoning
4/10 Coding
7/10 Speed
7/10 Cost efficiency
Specifications

Technical details

Model family Pharia-1-LLM-7B
Model type General Purpose
Context window 8K tokens
Knowledge cutoff 2023-04
Release date 2024-08-26
Status Available open-weight release; safety-aligned variant
Knowledge cutoff notes

The model card states that the web-crawled and structured pretraining data had a cutoff date of April 2023. This is a training-data cutoff, not a release date and not a guarantee that every fact before that date is represented.

Model notes

The model is the safety-aligned variant of Pharia-1-LLM-7B-control and received additional Direct Preference Optimization training for helpfulness and safety. It is trained across English, German, French, Italian, Spanish, Portuguese, and Dutch, with documented evaluation in English, German, French, and Spanish. The public Hugging Face release uses the Open Aleph License for non-commercial research and educational use. Aleph Alpha documents commercial access through its Intelligence Layer SDK and on-premise offerings. The model card states that training data had a cutoff date of April 2023. Editorial scores are comparative estimates rather than vendor specifications.

Cost

Model pricing

Input No public per-token price for the downloadable model; commercial hosted or on-premise access is available by agreement
Output No public per-token price for the downloadable model; commercial hosted or on-premise access is available by agreement
Model guide

Pharia-1-LLM-7B-control-aligned: A Safety-Aligned Multilingual Open-Weight Model

Pharia-1-LLM-7B-control-aligned is a 7-billion-parameter multilingual causal language model from Aleph Alpha Research. It is the safety-aligned variant of Pharia-1-LLM-7B-control, using additional Direct Preference Optimization training for helpfulness and safety while retaining a focus on German, French, Spanish, engineering, automotive, and other domain-specific applications.

What is Pharia-1-LLM-7B-control-aligned?

Pharia-1-LLM-7B-control-aligned is a 7-billion-parameter, decoder-only language model developed by Aleph Alpha Research. In practical terms, it takes text as input and generates text in response. It can be used for tasks such as drafting, classification, summarization, question answering, labeling, and conversational interactions.

The model belongs to the Pharia-1-LLM-7B family and is the safety-aligned counterpart to Pharia-1-LLM-7B-control. The two variants share the same general model family, while the aligned version received additional training intended to improve helpfulness and reduce harmful or undesirable responses. It is primarily a building block for applications, not a complete consumer chatbot or autonomous agent.

Aleph Alpha positions the Pharia family for multilingual and specialized deployments, including engineering and automotive use cases. This makes Pharia-1-LLM-7B-control-aligned most relevant to developers and organizations that want a comparatively compact European-language model they can run or integrate into a larger system.

Release, licensing, and access

Aleph Alpha announced Pharia-1-LLM-7B-control-aligned on August 26, 2024. The checkpoint is publicly available through Hugging Face, including an official repository and a Transformers-compatible safetensors conversion for local deployment.

The public weights are released under the Open Aleph License for non-commercial research and educational use. This is an important practical restriction: downloading the model does not automatically grant permission for commercial production use. Organizations planning a commercial deployment should review the license and obtain the appropriate terms from Aleph Alpha.

Aleph Alpha also describes commercial access through its Intelligence Layer SDK and customer on-premise installations. The supplied research does not identify a public per-token price for this model. Hosted or private commercial access is available by agreement rather than through a standard public pricing table. The public repository is not listed as being deployed by a Hugging Face Inference Provider, so users should not assume that a ready-made hosted endpoint is available there.

Architecture and context window

Pharia-1-LLM-7B-control-aligned is an autoregressive, causal transformer. Its published architecture uses 27 layers, 36 attention heads, four key-value heads, rotary position embeddings, a hidden dimension of 4,608, and approximately 7.04 billion parameters.

The model has an 8,192-token context window. The context window is the amount of input and conversational history the model can process in one request; it includes the prompt and any other text supplied as context, not just the answer. The supplied specifications do not define a separate maximum-output-token limit, so a precise maximum response length should not be assumed beyond the overall context constraint and the limits imposed by the chosen inference setup.

Its tokenizer uses SentencePiece Unigram technology and has a vocabulary of 128,000 tokens. The tokenizer was designed for multilingual European-language text, which can be useful when applications process German, French, Spanish, or other supported languages. Actual token usage still varies with the language and content.

Languages, inputs, and outputs

The underlying training corpus includes English, German, French, Italian, Spanish, Portuguese, and Dutch. The model card identifies English, German, Spanish, and French as evaluated languages. This language coverage is one of the model's clearest differentiators from models optimized mainly for English.

Pharia-1-LLM-7B-control-aligned is text-only. It accepts text input and produces text output. It does not natively accept images, audio, or video, and it does not generate images, audio, video, music, or other non-text media. Applications that need visual understanding, speech processing, or media generation would need additional models and integration layers.

The model supports conversational prompting with system, user, and assistant roles. Its recommended prompt format is derived from the Llama prompt format. Developers can load it locally using the Hugging Face Transformers conversion or Aleph Alpha's inference tooling, subject to the model's license and deployment requirements.

What the alignment changes

The original control model was instruction-fine-tuned for following instructions and handling multi-turn interactions. Pharia-1-LLM-7B-control-aligned received additional Direct Preference Optimization, or DPO, training. DPO uses preference data to encourage responses that better match desired qualities such as helpfulness, safety, and instruction adherence without requiring a separate reward-model workflow during the alignment stage.

This alignment is useful when the model will interact directly with users or produce content that needs more consistent behavioral safeguards. However, it should not be treated as a complete safety system. Aleph Alpha's documentation warns that the model can still generate harmful, biased, inaccurate, outdated, or otherwise unsuitable content.

For production use, developers should add application-level controls such as input validation, output review, domain-specific rules, access controls, and human oversight where the consequences of an error are significant. Alignment can influence model behavior, but it does not guarantee factual accuracy or compliance with every organization's policies.

Capabilities and practical performance

Documented uses include general text generation, classification, summarization, question answering, and labeling. These capabilities make the model suitable for workflows such as sorting incoming text, summarizing internal documents, creating first drafts, answering questions over a controlled context, and assigning categories to engineering or business records.

Its relatively small size is a practical advantage. A 7-billion-parameter model generally requires fewer resources to run than much larger language models, making local or private deployment more realistic. The trade-off is that it is not positioned as a frontier model for the most demanding reasoning, coding, long-context, or general-knowledge tasks.

The vendor's published evaluations indicate useful multilingual and engineering-domain performance against similarly sized open-weight models, although results vary by language and task. Those evaluations should be treated as provider-reported evidence rather than a guarantee for a particular application. Editorially, the model is better understood as a compact, controllable multilingual model than as a leading system for advanced reasoning or broad autonomous work.

The supplied comparative assessment rates its reasoning and coding capabilities at a modest level, while rating speed and cost efficiency more favorably. These are editorial estimates, not Aleph Alpha specifications. They reflect the model's intended trade-off: lower deployment demands and useful domain-oriented text processing in exchange for less capability on difficult reasoning and coding tasks.

Tools, structured output, and customization

No verified native tool-use or function-calling capability is specified for this model. It should therefore not be selected on the assumption that it can independently call APIs, browse the web, execute code, or operate external applications. Developers can potentially build orchestration around generated text, but that is an application feature rather than a confirmed native model capability.

A distinct JSON mode is not documented in the supplied specifications, and structured-output support is also unverified. The model may be prompted to produce JSON, but prompt-based formatting is not equivalent to a provider-guaranteed schema or constrained decoding mode. Applications that require machine-readable output should validate responses and handle malformed output.

Fine-tuning is listed as supported in the supplied model data. The exact fine-tuning workflow, supported training formats, infrastructure requirements, and commercial terms are not specified here. Users should confirm those details before designing a production customization process.

Main strengths and limitations

Strengths

  • Multilingual coverage across several European languages, with documented evaluation in English, German, French, and Spanish.
  • A comparatively compact 7-billion-parameter design that can be more practical for private or local inference than much larger models.
  • Additional DPO-based alignment focused on helpfulness and safety.
  • Useful coverage of common NLP tasks, including generation, summarization, classification, question answering, and labeling.
  • Positioning for engineering, automotive, and other domain-specific applications.
  • Availability as downloadable open weights for non-commercial research and education.

Limitations

  • The 8,192-token context window is modest for large document analysis or long-running conversations.
  • No native image, audio, or video input or output is documented.
  • No verified web search, code execution, tool calling, JSON mode, or function-calling interface is specified.
  • Performance is uneven across languages and tasks, and the model is not presented as a frontier reasoning or coding system.
  • The stated training-data cutoff is April 2023, so it does not provide current world knowledge without external retrieval.
  • The public Open Aleph License is limited to non-commercial research and educational use.
  • There is no public per-token price for the downloadable model, and commercial access is arranged by agreement.

When to choose this model

Choose Pharia-1-LLM-7B-control-aligned when the project needs a multilingual text model with a European-language focus, a manageable parameter count, and additional safety alignment. It is a reasonable candidate for private experimentation, internal document classification, summarization, multilingual labeling, engineering text workflows, and applications where organizations want more control over deployment than a purely hosted model provides.

It is particularly suitable when the workload can be handled within an 8,192-token context and does not require native media understanding, real-time web access, or autonomous tool use. Its local-deployment option can also be attractive when data governance or infrastructure control matters, although the license and operational requirements must be reviewed first.

Another type of model may be more appropriate for frontier reasoning, advanced software development, very long documents, multimodal analysis, current-information retrieval, or agentic workflows involving tools. A larger or newer model may provide stronger task performance, while a hosted commercial model may offer easier access, managed scaling, and documented structured-output or tool-calling features. Conversely, a smaller specialized model may be preferable when speed, memory usage, or narrowly defined classification cost matters more than broad generation quality.

Bottom line

Pharia-1-LLM-7B-control-aligned is best viewed as a compact, multilingual, safety-aligned open-weight language model for controlled text applications. Its strongest case is not maximum general intelligence; it is the combination of European-language coverage, domain-oriented positioning, local deployment potential, and additional alignment training. The main compromises are its limited context length, text-only design, unverified agent and structured-output features, modest frontier-task performance, April 2023 training cutoff, and non-commercial public license.


Answers to Frequently Asked Questions

What are the main limitations of Pharia-1-LLM-7B-control-aligned?
The model has an 8,192-token context window and a stated training-data cutoff of April 2023. It does not have documented native image, audio, or video capabilities, web search, code execution, tool calling, function calling, or guaranteed JSON mode. Although DPO alignment is intended to improve helpfulness and safety, the model can still produce inaccurate, biased, outdated, or harmful content and requires application-level safeguards.
What is the license for Pharia-1-LLM-7B-control-aligned?
The publicly available weights are released under the Open Aleph License for non-commercial research and educational use. Commercial production use is not automatically permitted; organizations should review the license and obtain appropriate commercial terms from Aleph Alpha. Commercial access may also be available through the Intelligence Layer SDK or on-premise installations by agreement.
What is Pharia-1-LLM-7B-control-aligned?
Pharia-1-LLM-7B-control-aligned is a 7-billion-parameter, decoder-only multilingual language model developed by Aleph Alpha Research. It generates text for tasks such as summarization, classification, question answering, labeling, drafting, and conversational applications. It is the safety-aligned variant of Pharia-1-LLM-7B-control.
What languages and modalities does Pharia-1-LLM-7B-control-aligned support?
The model was trained on English, German, French, Italian, Spanish, Portuguese, and Dutch, with English, German, French, and Spanish identified as evaluated languages. It is text-only: it accepts text input and produces text output, with no native support for images, audio, or video.


Sources 4
Provider

About Aleph Alpha