API
An OpenAI-compatible AI API, processed in the EU
Every endpoint uses the OpenAI or Anthropic request format, so the SDKs and frameworks you use today work unchanged. Requests are processed in European data centres and never used for training.
API
Endpoints
- Chat completionsSend chat messages to open-weight models with the OpenAI chat completions format. Requests are processed in EU data centres and never used for training.POST /v1/chat/completions
- ResponsesUse the OpenAI Responses API format with open-weight models on inference.eu. Typed output items, built-in tools and multi-turn state, processed in the EU.POST /v1/responses
- Messages (Anthropic format)Call open-weight models with the Anthropic Messages format on inference.eu. Works with Anthropic SDKs and Claude Code, processed in EU data centres.POST /v1/messages
- Count tokensCount the input tokens of a Messages request before you send it. Anthropic-compatible count_tokens endpoint on inference.eu, processed in the EU.POST /v1/messages/count_tokens
- List modelsList the open-weight models your inference.eu key can use with GET /v1/models, in the OpenAI format. Pick model ids for chat, embeddings, speech and more.GET /v1/models
- EmbeddingsTurn text into vectors for search, RAG and clustering with an OpenAI-compatible embeddings API. Open embedding models, processed in EU data centres.POST /v1/embeddings
- RerankRe-order search results by relevance with a rerank API for RAG. Cross-encoder reranker models such as bge-reranker-v2-m3, processed in EU data centres.POST /v1/rerank
- Speech to textTranscribe audio with Whisper through an OpenAI-compatible speech to text API. Meetings, calls and voice notes, processed in EU data centres.POST /v1/audio/transcriptions
- Text to speechGenerate natural speech from text with an OpenAI-compatible text to speech API. Open voice models for apps, IVR and accessibility, processed in the EU.POST /v1/audio/speech
- Image generationGenerate images from text prompts with an OpenAI-compatible images API. Open image models such as FLUX.1 schnell, processed in EU data centres.POST /v1/images/generations
- FilesUpload, list, download and delete files with an OpenAI-compatible files API. Use them for batch jobs and tools; stored in EU data centres.POST /v1/files
- BatchesRun thousands of chat or embedding requests as one asynchronous job with an OpenAI-compatible batch API. Upload JSONL, collect results, all in the EU.POST /v1/batches
Guides
- Migrate from OpenAIMove an application from OpenAI to open models processed in the EU. Change the base URL, key and model, then check tools, JSON output and embeddings.
- StreamingStream tokens from open models as they are generated, with OpenAI and Anthropic server-sent events. Examples, chunk format and error handling.
- Tool callingLet open models call your functions and APIs with OpenAI-compatible tool calling. Define tools, run the loop, handle arguments, processed in the EU.
- Structured outputsGet valid JSON that matches your schema from open models with OpenAI-compatible structured outputs. JSON mode, json_schema, strict mode and pitfalls.
- VisionSend images to open vision models with the OpenAI chat format. Read receipts, screenshots, forms and photos, with requests processed in EU data centres.
- Reasoning modelsUse open reasoning models that think before they answer. Control reasoning effort, read reasoning tokens and handle limits, processed in EU data centres.
- Prompt cachingReuse the processed start of a prompt across requests with automatic prompt caching. Structure prompts for cache hits and read cached_tokens in usage.
- Rate limits and errorsHow rate limits and errors work on the inference.eu API. HTTP status codes, the error object, rate-limit headers and a retry pattern that holds up.
Tools
- Document conversionConvert PDF, Word, PowerPoint and Excel files to clean Markdown for RAG and LLM prompts. Tables, headings and scanned pages, processed in the EU.POST /v1/documents/convert
- Remote MCP serversConnect remote MCP servers to model requests with the OpenAI Responses mcp tool. The API lists and calls the server's tools for you, processed in the EU.POST /v1/responses
- Web searchLet open models search the web during a request with the OpenAI Responses web_search tool. Current answers with source citations, run from the EU.POST /v1/responses
- Code executionLet open models write and run Python in a sandbox with the OpenAI Responses code_interpreter tool. Data analysis, calculations and files, run in the EU.POST /v1/responses
Move your AI workloads to EU infrastructure
Tell us which models you use and roughly how much traffic you have. We reply within one working day with pricing and next steps.
- Reply within one working day
- Pricing for your volume
- DPA ready to sign