Skip to main content
Kafka Connect is a data ETL framework provided by the Apache Kafka community for streaming data between Apache Kafka and other data systems. The AutoMQ BYOC edition provides a fully managed Kafka Connect service, aiming to further lower the entry barrier and operational costs for users. AutoMQ managed Kafka Connect eliminates the need for customers to install and deploy the Connect framework themselves. Users only need to create Connector tasks in the AutoMQ console or using Terraform, and the underlying AutoMQ console is responsible for starting the Connect Worker and Connector tasks. The Connect Worker is deployed directly in the EKS cluster within the user’s specified VPC, ensuring that data flows within the user’s network environment, balancing both security and the convenience of a managed service.
  • Network Dependency: AutoMQ Connect runs on an EKS (Amazon Elastic Kubernetes Service) cluster within the user’s VPC. The Connect Worker is deployed as a Pod in EKS and can directly access other resources within the user’s VPC (such as RDS, Redis, etc.) without complex network configurations.
  • Runtime Isolation: To ensure stability and security, each custom plugin runs on a separate Worker node, preventing a single plugin’s defects or high resource consumption from affecting the stability of the entire Connect cluster.