Managed Apache Kafka

Amazon MSK Connect and AWS Glue Schema Registry are now available in the AWS European Sovereign Cloud (Germany) region

Starting today, Amazon MSK Connect and the AWS Glue Schema Registry are available in the AWS European Sovereign Cloud (Germany) region.

Performance of the Cloud Storage Sink connector has been improved.

The improvements include reduced out-of-memory errors, higher maximum throughput, and avoiding creating a large number of small files.

The Service Level Agreement (SLA) for Managed Service for Apache Kafka now covers the Produce API.

For more information, see Managed Service for Apache Kafka Service Level Agreement.

The format for bootstrap addresses and broker URLs has changed for new Managed Service for Apache Kafka clusters.

To learn how to get a cluster's bootstrap address, see View a Managed Service for Apache Kafka cluster.

AWS Transform now supports Apache Kafka migration assessments for Amazon MSK

You can now use AWS Transform agentic migration assessments to evaluate the migration of on-premises Apache Kafka clusters to Amazon Managed Streaming for Apache Kafka (Amazon MSK).

You can configure a Managed Service for Apache Kafka cluster as a public cluster to let client applications connect over the public internet.

For more information, see Connect clients to a public cluster.

Amazon MSK Connect now supports restarting connectors

Amazon MSK Connect (Amazon Managed Streaming for Apache Kafka Connect) supports restarting newly created connectors and their tasks, enabling fast recovery for streaming data pipelines.

You can now configure the disk capacity per broker when you create a Kafka cluster and increase it later.

For more information, see Configure broker disk size.

MSK Replicator now supports OAuth 2.0 (SASL/OAUTHBEARER) authentication for replication from external Apache Kafka clusters to Amazon MSK

Amazon MSK Replicator now supports OAuth 2.0 (SASL/OAUTHBEARER) authentication for data replication from external Apache Kafka clusters - including on-premises, self-managed on AWS, or other cloud providers - to Amazon MSK Provisioned clusters.

Amazon MSK now supports configuring custom domain names for MSK Provisioned clusters

You can now easily configure custom domain names on Amazon MSK Provisioned clusters, on either ZooKeeper or KRaft mode for metadata management.

Amazon MSK now supports in-place migration from Apache ZooKeeper to KRaft

Amazon Managed Streaming for Apache Kafka (Amazon MSK) now supports in-place migration from Apache ZooKeeper to KRaft, enabling customers to migrate existing clusters to KRaft without provisioning new infrastructure, migrating data, or reconfiguring client applications.

Amazon MSK now delivers Kafka Authorizer Logs to customers

Amazon Managed Streaming for Apache Kafka (MSK) now supports Authorizer Log Delivery for Provisioned clusters, including both Standard and Express brokers, at no additional cost.

AWS Glue Schema Registry is now available in ten more AWS regions

You can now use the AWS Glue Schema Registry, a serverless and free feature of AWS Glue, in the Asia Pacific (New Zealand), Asia Pacific (Thailand), Asia Pacific (Hyderabad), Asia Pacific (Osaka), Asia Pacific (Malaysia), Asia Pacific (Melbourne), Mexico (Central), Israel (Tel…

Amazon MSK Express brokers now delivers Apache Kafka data to Amazon S3

Amazon MSK Express brokers now delivers data to Amazon S3 general purpose buckets, providing a fully managed capability to deliver Apache Kafka data in Amazon S3 for downstream processing in the easiest and most reliable way.

Amazon MSK Express brokers now deliver data to streaming tables for Apache Iceberg

Amazon MSK Express brokers now deliver data to streaming tables for Apache Iceberg, a new capability that continuously materializes Apache Kafka topics as Apache Iceberg tables on Amazon S3 Tables.

Amazon MSK Express Brokers adds support for Apache Kafka version 4.2

Amazon Managed Streaming for Apache Kafka (Amazon MSK) Express Brokers now supports Apache Kafka version 4.2. This release includes Eligible Leader Replicas (ELR) enhancements that strengthen availability with improved leader election correctness.

Amazon MSK Replicator now supports replication from external Apache Kafka clusters to MSK Standard brokers

Amazon MSK Replicator now supports data replication from external Apache Kafka clusters - including on-premises, self-managed on AWS, or other cloud providers to Amazon MSK Standard brokers.

Generally Available: Network Security Perimeter support for Azure Event Hubs

Azure Event Hubs now supports Network Security Perimeter (NSP), enabling organizations to define a logical network isolation boundary for PaaS resources and control public network access through perimeter-based access rules.

Generally Available: Confidential Computing support for Azure Event Hubs Dedicated

Azure Event Hubs Dedicated now supports Confidential Computing, enabling organizations to protect streaming data while it is being processed in memory.

MSK Replicator now supports mutual TLS (mTLS) authentication for replication from external Apache Kafka clusters to MSK Express brokers

Amazon MSK Replicator now supports mutual TLS (mTLS) authentication for data replication from external Apache Kafka clusters - including on-premises, self-managed on AWS, or other cloud providers - to Amazon MSK Express brokers.