AI solutions

On AWS: three variants in one cloud

Amazon Web Services hosts the AI model. Next to it, the AI gateway runs in one of three variants: self-managed on virtual machines, with managed services, or as Software as a Service.

On AWS in the EU

Architecture at a glance

High-level view: the office building and Amazon Web Services, in three variants. They differ in who operates which component.

1 · Self-managed on virtual machines (IaaS)

Office building

UsersSoftwareExcel · Google

Encrypted connection

Amazon Web Services in the EU

AI gatewayself-managed, on virtual machinesAI modelAmazon Bedrock

2 · Managed services: Amazon Bedrock AgentCore

Office building

UsersSoftwareExcel · Google

Encrypted connection

Amazon Web Services in the EU

AI gatewayself-managed, with pseudonymisationAgentCoreMCP gateway and agents, managed by AWSAI modelAmazon Bedrock

3 · Software as a Service: Amazon Quick

Office building

UsersSoftwareExcel · Google

Internet, encrypted

Amazon Web Services in the EU

AI gatewayAmazon Quick, managed by AWSAI modelAmazon Bedrock

Who operates what

Component	1 · Self-managed (IaaS)	2 · Managed services	3 · Software as a Service
AI model	Amazon Bedrock	Amazon Bedrock	Amazon Bedrock
Orchestrator and agents	Self-managed	AgentCore, managed by AWS	Amazon Quick, managed by AWS
AI gateway with pseudonymisation	Self-managed	Self-managed	Checkpoints of AWS
MCP gateway	Self-managed	Managed by AWS	Checkpoints of AWS

Self-managed: under the control of the client, operated by the client or by Ingenious NetworksManaged by AWS

Key facts

1 · Self-managed on virtual machines (IaaS)

The same software as on-premise, on virtual machines in Frankfurt, with a second entry point in Paris. Checkpoints, audit logs and connectors remain under the control of the client. The virtual machines are billed per month, the AI model by usage.

2 · Managed services: Amazon Bedrock AgentCore

AWS operates the MCP gateway, the agent runtime and the agent identity; fewer virtual machines are operated. The AI gateway with pseudonymisation remains self-managed. Available in the AWS region Frankfurt.

3 · Software as a Service: Amazon Quick

The managed AI service of AWS, licensed per user and month. It runs in Frankfurt on Amazon Bedrock and keeps the processing in the EU; custom connectors can be added. The checkpoints are operated by AWS.

SecurityProcessed in the EUAligned with BSI guidanceRequests and answers are not used to train AI modelsHow it is secured

Variant 1, self-managed, is aligned with the guidance of the BSI. In variants 2 and 3, AWS operates one of the two checkpoints; the cloud service Amazon Bedrock holds an attestation of type 2 against the C5 catalogue of the BSI (How it is secured). The on-premise deployment model uses AWS as well: there, only the AI model runs on Amazon Bedrock (On-premise).

The same AI gateway

The use cases, and the other deployment models

The functions of the AI gateway are identical in every deployment model.

Where AI helps: the areas of a company and the business applications

GPT on Azure in the EUGPT models on Microsoft Azure in EU data zones, with the AI gateway operated by Ingenious Networks.On-premise in the EUIn the office building in the EU, on company-owned servers.European cloudOn virtual machines of a European cloud provider, implemented and operated by Ingenious Networks.Software as a Service in the EUThe provider operates the AI gateway in EU data centres. The shortest time to deployment.

Contact

Your AI. Your data. In the EU.

Discuss a use case with us

20 minutes, without obligation: the situation is described, and we say what AI can realistically do, and what it cannot.

Open the form

Email: contact@ingnetworks.com
Phone: +49 1515 3851511
Address: Ingenious Networks GmbH
Eisenacher Straße 6
10777 Berlin, Germany