# AutoMQ Documentation: Chinese ## Chinese - [Chinese / AutoMQ BYOC (125 pages)](https://docs.automq.com/_llms/cn/auto-mq-byoc.txt): 产品介绍, 快速开始, AutoMQ on Kubernetes, 订阅和计费, 管理环境, 管理账号成员, 管理 AutoMQ, 迁移到 AutoMQ, 安全配置, Kafka Connect, 监控报警, Table Topic, 最佳实践, 消除跨可用区数据传输, 版本记录, 服务支持, 附录. ### AutoMQ Open Source #### 关于 AutoMQ - [概述](https://docs.automq.com/zh/automq/what-is-automq/overview.md): AutoMQ 是基于 S3 构建的云原生流处理平台,完全兼容 Apache Kafka,可将存储成本降低高达 90%,并提供秒级弹性伸缩能力。 - [与 Apache Kafka 的区别](https://docs.automq.com/zh/automq/what-is-automq/difference-with-apache-kafka.md): AutoMQ 是新一代 Apache Kafka 发行版,基于存算分离架构提供弹性和成本优势,比传统 Kafka 更快、更经济,且完全兼容。 - [与多级存储的区别](https://docs.automq.com/zh/automq/what-is-automq/difference-with-tiered-storage.md): AutoMQ 使用对象存储为主存储,无需额外复制,显著节省存储与计算资源,并支持秒级分区迁移及超高性价比EBS使用。 - [Apache Kafka 兼容性](https://docs.automq.com/zh/automq/what-is-automq/compatibility-with-apache-kafka.md): AutoMQ 是云原生可扩展且与 Apache Kafka 完全兼容的下一代 Kafka 服务,支持快速版本适配和高效运行。 - [许可证和版本对比](https://docs.automq.com/zh/automq/what-is-automq/licensing-and-enterprise-features.md): AutoMQ offers scalable cloud-native Kafka compatibility with AutoMQ Cloud service. Enjoy hassle-free deployment, zero maintenance, and a 30-day free trial. #### 快速开始 - [Docker 部署多节点测试集群](https://docs.automq.com/zh/automq/getting-started/deploy-multi-nodes-test-cluster-on-docker.md): Deploy a scalable AutoMQ 3-node cluster using Docker to test Kafka-compatible features like partition reassignment and automatic data balancing efficiently. ##### Explore AutoMQ - [示例:验证秒级分区迁移](https://docs.automq.com/zh/automq/getting-started/explore-automq/example-partition-reassignment-in-seconds.md): AutoMQ's Kafka-compatible cloud service enables rapid partition migration in seconds, ensuring seamless scalability and efficient data management in diverse environments. - [示例:持续数据自平衡](https://docs.automq.com/zh/automq/getting-started/explore-automq/example-continuous-data-self-balancing.md): AutoMQ ensures seamless Kafka data rebalance in real-time, maintaining cloud-native scalability and cost efficiency by optimizing load distribution across brokers. - [示例:集群节点变化触发分区自平衡](https://docs.automq.com/zh/automq/getting-started/explore-automq/example-self-balancing-when-cluster-nodes-change.md): AutoMQ ensures seamless data rebalance and partition migration during node scaling with cloud-native scalability and full Kafka compatibility, enhancing reliability. #### 部署 - [概述](https://docs.automq.com/zh/automq/deployment/overview.md): AutoMQ 致力于多公共云和私有云兼容部署,支持 AWS、Azure、GCP、Alibaba Cloud 及 Ceph、CubeFS、MinIO 和 HDFS,提供云原生可扩展性和 Kafka 兼容性。 - [Linux 主机部署多节点集群](https://docs.automq.com/zh/automq/deployment/deploy-multi-nodes-cluster-on-linux.md): 在 Linux 主机上部署多节点 AutoMQ 集群,兼容 Kafka API,支持对象存储集成和云原生性能。 - [Kubernetes 部署多节点集群](https://docs.automq.com/zh/automq/deployment/deploy-multi-nodes-cluster-on-kubernetes.md): 在 Kubernetes 上部署多节点 AutoMQ 集群,完全兼容 Kafka API,支持云原生高效运维。 - [服务端性能调优](https://docs.automq.com/zh/automq/deployment/performance-tuning-for-broker.md): Optimize AutoMQ server performance with memory allocation strategies and network tuning for stable, efficient operation. Tailored for specific hardware and scenarios. - [客户端性能调优](https://docs.automq.com/zh/automq/configuration/performance-tuning-for-client.md): Optimize AutoMQ setup for cloud-native throughput with tailored client configurations, leveraging Kafka compatibility and object storage for high efficiency. - [性能测试](https://docs.automq.com/zh/automq/deployment/automq-benchmark.md): Optimize AutoMQ’s Kafka compatibility with rapid elasticity, high performance, and cost efficiency built on S3 storage. Test cluster performance with robust tools. #### 迁移 - [概述](https://docs.automq.com/zh/automq/migration/overview.md): AutoMQ 是云原生的下一代 Kafka 兼容服务,支持从 Apache Kafka 和其他 Kafka 发行版无缝迁移,提供高兼容性和成本效益。 - [从 Apache Kafka 迁移到 AutoMQ](https://docs.automq.com/zh/automq/migration/migrating-from-apache-kafka-to-automq.md): AutoMQ 提供成本更优、弹性更强的 Kafka Server 方案,兼容所有 Apache Kafka 版本,助力轻松完成迁移,实现业务无缝转移。 #### 可观测 - [概述](https://docs.automq.com/zh/automq/observability/overview.md): AutoMQ ensures Apache Kafka compatibility with cloud-native scalability, offering advanced monitoring via JMX and Prometheus for efficient observability. - [将 Metrics 集成到 Prometheus](https://docs.automq.com/zh/automq/observability/integrating-metrics-with-prometheus.md): 将 AutoMQ 与 Prometheus 集成,实现 Metrics 数据的一站式采集查询。AutoMQ 提供 Kafka 兼容性,云原生可扩展性和成本效益。 - [仪表盘配置](https://docs.automq.com/zh/automq/observability/dashboard-configuration.md): Optimize AutoMQ's Kafka-compatible monitoring with Grafana dashboards. Get performance insights on clusters, brokers, topics, and groups for peak efficiency. - [Prometheus Metrics](https://docs.automq.com/zh/automq/observability/prometheus-metrics.md): Discover AutoMQ's comprehensive Prometheus metrics for enhanced performance insights with cloud-native scalability, full Kafka API compatibility, and cost efficiency. #### 技术架构 - [概述](https://docs.automq.com/zh/automq/architecture/overview.md): AutoMQ 提供纯粹云原生的共享存储架构,与 Apache Kafka 完美兼容,具备十倍成本优势、百倍运维效率提升,完全实现弹性扩展。 ##### S3Stream:共享流存储库 - [概述](https://docs.automq.com/zh/automq/architecture/s3stream-shared-streaming-storage/overview.md): AutoMQ S3Stream:核心流存储库,通过灵活的 WAL 选项与 S3 提供低延迟、高吞吐、低成本及无限容量的流存储解决方案。 - [S3 存储](https://docs.automq.com/zh/automq/architecture/s3stream-shared-streaming-storage/s3-storage.md): AutoMQ企业版通过创新的S3存储架构,实现了云原生扩展性和Kafka兼容性,以低成本高效存储和流量实时重平衡。 - [WAL 存储](https://docs.automq.com/zh/automq/architecture/s3stream-shared-streaming-storage/wal-storage.md): AutoMQ 作为下一代云原生 Kafka 兼容服务,提供多种 WAL 存储介质(EBS、Regional EBS、S3),确保数据低延迟高性能写入和故障恢复。 ##### 技术优势 - [概览](https://docs.automq.com/zh/automq/architecture/technical-advantage/overview.md): AutoMQ 采用存储计算分离架构,原生支持 Kafka 协议,实现秒级分区迁移和平滑扩缩容,具备冷读效率和无状态 Broker 等诸多优势。 - [冷热隔离 & 5 倍冷读效率](https://docs.automq.com/zh/automq/architecture/technical-advantage/5x-catch-up-read-efficiency.md): AutoMQ 通过冷热隔离架构,解决 Kafka 冷读问题,提升冷读效率 5 倍,同时确保写入性能不受影响,适合多租户场景。 - [持续数据自平衡](https://docs.automq.com/zh/automq/architecture/technical-advantage/continuous-self-balancing.md): AutoMQ 采用云原生架构,具备秒级分区迁移能力,实现内置自动数据平衡,动态优化集群流量并简化管理。 - [原生支持 Kafka 协议](https://docs.automq.com/zh/automq/architecture/technical-advantage/native-compatible-with-apache-kafka.md): AutoMQ 原生支持 Kafka 协议,提供云原生可扩展性和成本效益,通过存算分离架构实现 100% Apache Kafka 协议和语义兼容。 - [秒级分区迁移](https://docs.automq.com/zh/automq/architecture/technical-advantage/partition-reassignment-in-seconds.md): AutoMQ 的共享存储架构实现秒级分区迁移,保障快速扩容与高效运维,提升集群弹性和可靠性。 - [秒级平滑扩缩容](https://docs.automq.com/zh/automq/architecture/technical-advantage/scale-outin-in-seconds.md): AutoMQ具备秒级平滑扩缩容能力,实现云原生弹性,无需手动干预,降低成本,提升稳定性,确保资源高效利用并支持多租户环境。 - [无状态 Broker](https://docs.automq.com/zh/automq/architecture/technical-advantage/stateless-broker.md): AutoMQ 采用存算分离与无状态 Broker 设计,简化运维及扩缩容,支持使用云上 Spot 实例,进一步降低成本,提供完全的 Kafka API 兼容性。 #### Table Topic - [概述](https://docs.automq.com/zh/automq/table-topic/overview.md): AutoMQ’s Table Topic offers seamless Iceberg integration for real-time data lake analytics without ETL. Enjoy automatic scalability and cost-efficient AWS S3 integration. - [Table Topic 快速开始](https://docs.automq.com/zh/automq/table-topic/table-topic-quick-start.md): AutoMQ’s Table Topic seamlessly integrates streaming data with static data lakes, solving traditional ETL challenges, with quick deployment via Docker. - [Table Topic 配置](https://docs.automq.com/zh/automq/table-topic/table-topic-configuration.md): Optimize your Kafka data transformation with AutoMQ's Table Topic configurations. Benefit from cloud-native scalability and complete Kafka compatibility while managing Iceberg schemas seamlessly. #### 消除跨可用区数据传输 - [概述](https://docs.automq.com/zh/automq/eliminate-inter-zone-traffics/overview.md): AutoMQ eliminates cross-zone data transfer costs using S3 storage architecture, offering cloud-native scalability and 100% Kafka compatibility. - [Broker 配置](https://docs.automq.com/zh/automq/eliminate-inter-zone-traffics/broker-configuration.md): AutoMQ optimizes Kafka operations with cloud-native scalability and cross-AZ routing for cost efficiency, reducing inter-zone traffic and ensuring data locality. - [客户端配置](https://docs.automq.com/zh/automq/eliminate-inter-zone-traffics/client-configuration.md): Optimize Kafka-based cloud infrastructure with AutoMQ: Enjoy cloud-native scalability, cost efficiency, and seamless Zone configuration for elevated data management. - [监控跨 AZ 流量](https://docs.automq.com/zh/automq/eliminate-inter-zone-traffics/monitor-inter-zone-traffic.md): Monitor cross-AZ traffic with AutoMQ's Kafka-compatible service for cloud-native data flow optimization. Gain insights into network performance efficiently. #### 生态集成 ##### 数据分析 - [Apache Doris](https://docs.automq.com/zh/automq/integrations/data-analysis/apache-doris.md): 使用 AutoMQ 将数据导入 Apache Doris,享受云原生扩展性和 100% Kafka API 兼容性,实现高效数据传输与分析。 - [Databend](https://docs.automq.com/zh/automq/integrations/data-analysis/databend.md): AutoMQ与Databend融合:利用云原生Kafka服务AutoMQ,将数据无缝导入高效的Rust构建数据仓库Databend,支持数据湖和数据仓库一体化。 - [Flink](https://docs.automq.com/zh/automq/integrations/data-analysis/flink.md): AutoMQ 是一款云原生的 Kafka 服务,提供高效的成本降低和弹性优势。本指南展示了如何在 Flink 中实现 Word Count 分析。 - [RisingWave](https://docs.automq.com/zh/automq/integrations/data-analysis/risingwave.md): 将数据从 AutoMQ 导入到兼容PostgreSQL的分布式流数据库RisingWave,享受云原生扩展性和Kafka兼容性带来的便捷。 - [StarRocks](https://docs.automq.com/zh/automq/integrations/data-analysis/starrocks.md): AutoMQ 通过 Kafka 提供高扩展性与成本效益,本文介绍如何使用 StarRocks Routine Load 将 AutoMQ 中的数据导入 StarRocks,提升实时数据分析能力。 ##### 数据集成 - [Airbyte](https://docs.automq.com/zh/automq/integrations/data-integration/airbyte.md): AutoMQ revolutionizes data integration with cloud-native scalability, 100% Kafka compatibility, and cost efficiency, enabling seamless real-time data analytics integration with Airbyte and Databricks. - [Debezium](https://docs.automq.com/zh/automq/integrations/data-integration/debezium.md): AutoMQ integrates seamlessly with Debezium for real-time database change monitoring, offering cloud-native scalability, Kafka compatibility, and cost efficiency. ##### Kafka 控制台 - [Kafdrop](https://docs.automq.com/zh/automq/integrations/kafka-ui/kafdrop.md): 全面讲解如何在 AutoMQ 上集成使用 Kafdrop,以简化对 Kafka 集群的监控和管理,提高集群性能和资源利用率。 - [Redpanda Console](https://docs.automq.com/zh/automq/integrations/kafka-ui/redpanda-console.md): 使用 Redpanda Console 管理和监控 AutoMQ 集群,实现高效可视化操作,确保系统的可维护性和稳定性,优化集群性能和资源利用率。 ##### 可观测 - [Flashcat](https://docs.automq.com/zh/automq/integrations/observability/flashcat.md): AutoMQ 提供基于云的无缝Kafka兼容流处理系统,实现高弹性、低成本及简化运维,夜莺监控系统支持全面监控AutoMQ集群,保障业务稳定性。 - [观测云](https://docs.automq.com/zh/automq/integrations/observability/guance-cloud.md): AutoMQ 提供云原生可扩展性、完全兼容 Kafka 协议,并能通过观测云进行高效的实时监测,实现高达10倍的成本优势和高可靠性。 - [Prometheus](https://docs.automq.com/zh/automq/integrations/observability/prometheus.md): Optimize AutoMQ's scalability and monitoring with Prometheus and VictoriaMetrics. Ensure efficient Kafka-compatible data processing in cloud-native environments. #### 配置 - [Broker 和 Controller 配置](https://docs.automq.com/zh/automq/configuration/broker-and-controller-configuration.md): Optimize your AutoMQ deployment with cloud-native scalability, full Kafka compatibility, and cost-efficient configurations, supporting seamless integration with modern data lakes. - [对象存储配置](https://docs.automq.com/zh/automq/configuration/object-storage-configuration.md): Discover AutoMQ's cloud-native Kafka distribution utilizing object storage services from major cloud providers. Achieve optimal scalability and cost efficiency. #### 版本 - [软件制品](https://docs.automq.com/zh/automq/releases/software-artifact.md): AutoMQ 是云原生的 Kafka 兼容服务,提供高效的性能和可扩展性,支持 AutoMQ Open Source 开源版和商业版本。下载最新版本即可开始。 - [Release notes](https://docs.automq.com/zh/automq/releases/release-notes.md) #### 测试报告 - [AutoMQ vs. Apache Kafka 性能和成本对比](https://docs.automq.com/zh/automq/benchmarks/automq-vs-apache-kafka-benchmarks-and-cost.md): AutoMQ revolutionizes Kafka storage with cloud-native architecture, ensuring a 14x cost reduction while maintaining 100% Kafka API compatibility and superior scalability. #### 引用 - [术语](https://docs.automq.com/zh/automq/reference/glossary.md): AutoMQ 提供云原生的 Apache Kafka 兼容服务,具备高成本效益和弹性,通过EBS和S3对象存储实现低延迟消息处理和无限容量扩展。