Which models are available?

Open-weight models for chat, reasoning, code, embeddings, reranking, speech and images, from European and international labs. Each model page lists its maker, licence and context length, and the request id to use. New open-weight releases are added to the same endpoint, so you can try them without changing anything else.

Do I have to rewrite my code?

No. If you use an OpenAI SDK, or a framework built on one, change the base URL and the API key. Prompts, tools and streaming work as before, and you choose a model by its name in the request, just as you do today.

Can I use the Anthropic Messages format?

Yes. The API also accepts requests in the Anthropic Messages format, so clients and SDKs written for Claude work unchanged, with Claude itself or any open-weight model hosted in the EU. Set the base URL and key in the client, then choose a model by its name.

Is my data used to train models?

No. Requests are processed to produce your response and are not used to train any model. The same commitment is written into the data processing agreement you sign with us, so it is a contractual term rather than a promise on a web page.

Where exactly are requests processed?

In data centres located in the European Union. If a location fails, traffic moves to another European location rather than to a region outside the EU. You get the list of locations and subprocessors with your data processing agreement.

Can I use an EU LLM API like this under the GDPR?

That depends on your data and your purpose, which only you can assess. We give your data protection officer what they need to do it, with processing in the EU, a data processing agreement under GDPR Article 28, a full list of subprocessors and a contractual commitment not to train on your data.

How is this different from a US AI provider?

Your requests stay in European data centres instead of going to the United States. The models are open-weight, with published weights, so you are never tied to one company's model. Billing is in euros, and one data processing agreement covers every model on the platform.

How does billing work?

You pay for what you use, measured in tokens for language models, and receive one invoice in euros covering every model and every API key in your workspace. You don't need a separate contract or account with each model maker.

Can I use embeddings and rerank for RAG?

Yes. Embedding models turn your documents into vectors for a search index, and rerank models sort the retrieved passages by relevance before they reach a chat model. Both run behind the same API and key, so a whole retrieval pipeline stays in the EU.

Do you have speech and image models?

Yes. Speech-to-text models transcribe audio, text-to-speech models read text aloud, and image models generate pictures from a text prompt. They use the same key and the same invoice as the language models, so you don't need a second provider for audio or images.

What is the difference between open-source and open-weight?

An open-weight model publishes its trained weights so anyone can run it, often under a licence with conditions. Open-source in the strict sense also covers the training code and data. Each model page links to its licence, so you can check what commercial use it allows.

How do I move off a US AI provider?

Start with one workload. Point your existing code at the EU base URL, pick an open-weight model of similar size and compare outputs on your own test prompts. Expect to adjust a prompt or two, then move the remaining traffic once the quality matches what you need.

Can I run my own fine-tuned model?

Yes, on a dedicated GPU server that you rent by the hour in a European data centre. You serve your own weights there, behind an endpoint you control, and the hours appear on the same invoice in euros as your API usage.

LLM API hosted in the EU

An EU LLM API for developers, serving Claude, Gemini and open models

Send your prompts to Claude, Gemini and open-weight models running in European data centres instead of a US provider. The API uses the OpenAI format, and accepts the Anthropic Messages format too, so your existing code works after you change the base URL and key.

Contact sales Every model, one EU endpoint

How it works

Works with the OpenAI SDK
Python, JavaScript, LangChain, LlamaIndex, the Vercel AI SDK and anything else that speaks the OpenAI format. Change the base URL and key; nothing else.
Speaks the Anthropic format too
Clients written for the Anthropic Messages API call the same open-weight models. Point them at the EU endpoint and pick a model.
Switch models with one string
Every model sits behind the same endpoint. Try a different one by changing the model name in the request.
Requests processed in the EU
Prompts and responses are processed in European data centres, and failover moves traffic to another European location.
Never used for training
What you send is used to answer the request and nothing else. It never goes into a training run.
Chat, code, embeddings and speech
Text and code generation, embeddings and reranking for search, speech to text and image models, all with one key.
Priced per token, billed in euros
Pay for the tokens you use, on one invoice covering every model.

Every model, one EU endpoint

Claude, Gemini and open-weight models for chat, code, embeddings, reranking, speech and images. Switch between them by changing the model string.

Chat

Reranking

BGE Reranker v2 M3Run bge-reranker-v2-m3 on inference.eu: a light multilingual reranker that sorts search and RAG results by relevance, processed in the EU.BAAI (Beijing Academy of Artificial Intelligence) · 568M

Embeddings

Reasoning

OCR and documents

DeepSeek-OCR 2Run DeepSeek-OCR 2 on inference.eu: a 3B open OCR model that turns scans and PDFs into Markdown, processed in EU data centres, not in China.DeepSeek · 3B

Code

Vision

Speech to text

Switch from OpenAI by changing one line

The API uses the OpenAI request format, so the SDKs and frameworks you already use work as they are. Change the base URL and the key, then compare models on your own prompts.

from openai import OpenAI

client = OpenAI(
    base_url="https://api.inference.eu/v1",
    api_key="INFERENCE_EU_API_KEY",
)

response = client.chat.completions.create(
    model="mistral-small-4-119b",
    messages=[{"role": "user", "content": "Summarise this contract in three bullet points"}],
)
print(response.choices[0].message.content)

import OpenAI from "openai"

const client = new OpenAI({
  baseURL: "https://api.inference.eu/v1",
  apiKey: process.env.INFERENCE_EU_API_KEY,
})

const response = await client.chat.completions.create({
  model: "mistral-small-4-119b",
  messages: [{ role: "user", content: "Summarise this contract in three bullet points" }],
})
console.log(response.choices[0].message.content)

curl https://api.inference.eu/v1/chat/completions \
  -H "Authorization: Bearer $INFERENCE_EU_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "mistral-small-4-119b",
    "messages": [{"role": "user", "content": "Summarise this contract in three bullet points"}]
  }'

What teams use it for

AI features in a SaaS product
Add chat, summaries or search to your product without sending your customers' data outside the EU.
Search over internal documents
Embed contracts, tickets and wikis, then answer questions about them with retrieval-augmented generation.
Moving off a US AI provider
Keep your prompts and code, point them at an EU endpoint, and compare quality model by model.
Agents and coding tools
Run coding assistants and agents on open-weight models in the EU, through the OpenAI or Anthropic format.

Models: common questions

The questions buyers, developers and legal teams ask us most. Something missing? Ask us directly.

Ask a question

Move your AI workloads to EU infrastructure

Tell us which models you use and roughly how much traffic you have. We reply within one working day with pricing and next steps.

Reply within one working day
Pricing for your volume
DPA ready to sign

An EU LLM API for developers, serving Claude, Gemini and open models

How it works

Works with the OpenAI SDK

Speaks the Anthropic format too

Switch models with one string

Requests processed in the EU

Never used for training

Chat, code, embeddings and speech

Priced per token, billed in euros