inference.eu

Reasoning · OpenAI

Run gpt-oss-120b in the EU through an OpenAI-compatible API

gpt-oss-120b is OpenAI's larger open-weight reasoning model: 117 billion parameters with 5.1 billion active per token, released under Apache 2.0. On inference.eu you keep the OpenAI SDK and request format you already use, but your prompts are processed in EU data centres and never used for training.

  1. 01117B · 5.1B
  2. 02EU data centres
  3. 03Apache 2.0

What gpt-oss-120b is

gpt-oss-120b is one of two open-weight models OpenAI released in August 2025. It is a mixture-of-experts model with 117 billion parameters, of which 5.1 billion are active for each token, and a context window of 128K tokens. Its expert weights were post-trained in MXFP4 precision, which lets the full model run on a single 80 GB GPU.

It is a reasoning model: before answering it works through the problem in a chain of thought, and you choose the reasoning effort per request, from low for quick replies to high for careful analysis. It was trained on OpenAI's harmony response format and supports function calling and structured outputs. It handles text only.

What it does well, and where it falls short

gpt-oss-120b is strong at reasoning, maths, coding and tool use for its active size, and it is a natural first step for teams moving off OpenAI's hosted models: the behaviour and prompt style feel familiar, and structured outputs and function calling work the way OpenAI users expect. The low number of active parameters keeps it efficient.

It does not accept images or audio. Its knowledge is older than that of 2026 models such as Qwen3.8 or DeepSeek V4, which beat it on many agentic coding tasks. OpenAI does not publish a list of supported languages on the model card, so test European languages on your own content. High reasoning effort can produce many output tokens.

Calling gpt-oss-120b through the API

If you use the OpenAI SDK today, switching is two lines: set the base URL to the inference.eu API and use your inference.eu key. Then set the model to gpt-oss-120b. The harmony format is handled on our side, so you send ordinary chat messages and receive ordinary responses.

Set reasoning_effort to low, medium or high to trade speed against depth. Tool calls, JSON schema outputs and streaming work as usual. The model's chain of thought is meant for debugging rather than for end users, so show only the final answer in your product. The Anthropic Messages format is available as well.

OpenAI's model, processed in the EU

Using gpt-oss-120b on inference.eu is not the same as using OpenAI's own API. The open weights run on infrastructure in the European Union, your prompts and the responses are processed in EU data centres, nothing is sent to OpenAI, and nothing is used to train any model.

Every customer receives a data processing agreement under Article 28 of the GDPR and our list of subprocessors, so there is no transfer of prompts to the United States to assess. Billing is in euros. The Apache 2.0 licence allows commercial use without user limits; OpenAI also publishes a short usage policy for the gpt-oss models.

gpt-oss-120b · Python
import os
from openai import OpenAI

client = OpenAI(base_url="https://api.inference.eu/v1", api_key=os.environ["INFERENCE_EU_API_KEY"])

response = client.chat.completions.create(
    model="gpt-oss-120b",
    messages=[{"role": "user", "content": "Summarise this contract in five bullet points."}],
)
print(response.choices[0].message.content)

What teams use it for

  • 1

    Leaving a US AI provider

    Keep your OpenAI SDK code and prompt style, and move a workload to an EU-hosted open model with a two-line change.

  • 2

    Analytical assistants

    Answer questions that need several steps of reasoning, such as checking contracts against rules or explaining financial figures.

  • 3

    Agents with structured outputs

    Run agents that call tools and return strict JSON schemas, with adjustable reasoning effort per step.

gpt-oss-120b: common questions

The questions buyers, developers and legal teams ask us most. Something missing? Ask us directly.

Ask a question

Move your AI workloads to EU infrastructure

Tell us which models you use and roughly how much traffic you have. We reply within one working day with pricing and next steps.

  • Reply within one working day
  • Pricing for your volume
  • DPA ready to sign