Public Preview: AI Gateway in Azure API Management

The AI Gateway tier for Azure API Management is now available in public preview. Building on the AI gateway capabilities already available across API Management tiers, the new AI Gateway tier provides a dedicated experience optimized for AI workloads.

As organizations operationalize AI, platform teams need a consistent way to securely expose AI assets including AI models, MCP servers, and tools. AI Gateway helps organizations apply consistent security, policies, authentication, observability, and operational controls across AI workloads.

Built on the trusted, enterprise-grade Azure API Management platform, AI Gateway provides portal and programmatic experiences optimized for AI. The experience is centered on models, MCP servers, and tools, making it easier for platform teams to discover, expose, secure, and observe AI assets.

The public preview supports models hosted from Microsoft Foundry as well as models hosted in AWS Bedrock, Google Vertex AI, OpenAI, and Anthropic. It also extends the same consistent controls to MCP servers, created from existing MCP backends, OpenAPI definitions, or connectors, with built-in policy enforcement, OpenTelemetry-based observability, and enterprise authentication.

Learn more:

• Announcement blog
• Documentation
• Build your first AI Gateway resource