Deploy to Baidu Cloud CCE

Refer to Overview▸, AutoMQ supports deployment on Kubernetes. This article describes the installation process of deploying AutoMQ on the Baidu Cloud CCE platform.

In this article, references to AutoMQ Product Service Provider, AutoMQ Service Provider, and AutoMQ specifically refer to AutoMQ HK Limited and its subsidiaries.

Operation Process

Step 1: Install Control Console

Refer to Overview▸, AutoMQ supports deployment on CCE clusters. In the CCE deployment mode, you need to first install the AutoMQ control console and then use the console interface to manage CCE and deploy the data plane cluster to CCE.

Note:

To deploy an AutoMQ data plane cluster on CCE, you need to pull Docker images and Helm Chart artifacts from the public internet. Therefore, the VPC environment must support external internet access via SNAT or other methods.

On Baidu Cloud, you need to install the AutoMQ console directly using the BCC image. The steps to install the AutoMQ console are as follows:

1. The AutoMQ console accesses cloud resources through IAM role authorization. Therefore, before installing the console, permission to access cloud resources needs to be granted to the AutoMQ console. Follow these steps: go to the IAM Console and follow the steps below:

   1. Create a custom authorization policy using the policy content referenced in the document below.

   2. Create a custom IAM role and choose the authorization type as Cloud Product > BCC Instance.

   3. Attach the authorization policy to the IAM role.

{
  "id": "policy_8dc24a2639514662a4cc129f47dcb310",
  "version": "v2",
  "accessControlList": [
    {
      "service": "bce:cce",
      "region": "bj",
      "resource": [
        "*"
      ],
      "effect": "Allow",
      "permission": [
        "READ"
      ]
    },
    {
      "service": "bce:ld",
      "region": "bj",
      "resource": [
        "*"
      ],
      "effect": "Allow",
      "permission": [
        "READ",
        "OPERATE",
        "FULL_CONTROL"
      ]
    },
    {
      "service": "bce:network",
      "region": "bj",
      "resource": [
        "*"
      ],
      "effect": "Allow",
      "permission": [
        "READ",
        "OPERATE",
        "FULL_CONTROL"
      ]
    },
    {
      "service": "bce:bos",
      "region": "*",
      "resource": [
        "*"
      ],
      "effect": "Allow",
      "permission": [
        "ListBuckets"
      ]
    },
    {
      "service": "bce:bos",
      "region": "*",
      "resource": [
        "*"
      ],
      "effect": "Allow",
      "permission": [
        "READ",
        "FULL_CONTROL",
        "LIST"
      ]
    }
  ]
}

1. Go to the BCC Console and click Create Instance. Configure the following parameters as suggested to complete the creation of the BCC instance.

   1. Region and Availability Zone: Select the region and availability zone where the data plane cluster will be deployed in the future to ensure VPC internal network communication.

   2. Instance Configuration: It is recommended to choose at least a 2-core 8GB instance specification.

   3. Image Type: Select the custom image. Please contact AutoMQ technical personnel in advance to obtain the AutoMQ console host image.

   4. Storage: In addition to the default system disk, you need to create an additional cloud disk of at least 40GB (general-purpose SSD recommended).

   5. Private Network: Select the VPC where the data plane will be deployed in the future, i.e., the VPC where the AutoMQ-based application resides.

   6. Security Group: Choose as needed, making sure to set the inbound rules to allow port 8080. The AutoMQ console exposes the web service through port 8080.

2. After the instance is created, select the BCC instance, click on More Actions on the right, and choose Set IAM Role. Bind the IAM role created in the previous step to the BCC instance where the AutoMQ console is located.

3. Log in to the Console to proceed to the next step of initialization configuration.

The initial username for the first access to the Baidu Cloud AutoMQ console is admin, and the initial password is the instance ID of the BCC instance. You must change the password immediately after the first login.

Step 2: Create a CCE Cluster

Refer to Overview▸, where users need to create a dedicated CCE cluster in advance for AutoMQ usage. Users can follow the steps below by accessing the Baidu Cloud CCE product console.

1. Log in to the Baidu Cloud CCE Console. Click Create Cluster, and select Standard Managed Cluster.

2. Choose the billing model and version based on recommendations. For cluster size, it is advised to select at least L50 nodes.

Refer to the following requirements for network configuration settings:

• Private Network: Select the VPC network where the application is located, ensuring it is consistent with the network where the console is located.

• API Server Access: Choose to automatically create a load balancer.

• API Server Subnet: Select the subnet planned for installation.

• Container subnet: Select the subnet for deploying the AutoMQ instance. It is recommended to choose a single subnet or three subnets.

3. Create new nodes for deploying Kubernetes system components. When adding Worker nodes, pay attention to the following configurations:

   • Number of nodes: It is recommended to have at least 2 nodes.

   • Node specifications: It is recommended to use BCC instances with at least 4C8G specifications.

4. Click on Create Cluster and wait a few minutes for the creation to complete.

5. After creating the cluster, access the cluster details, Operations and Management, component management, and install the CCE CSI CDS storage plugin.

Step 3: Create IAM Role and Dedicated AutoMQ CCE Node Pool

Refer to Overview▸, users need to create a dedicated node pool and the corresponding IAM role for AutoMQ to facilitate subsequent deployment instances. Follow the steps below to create the IAM role and the compliant node pool.

1. Go to the IAM Console, create an IAM role without granting any permissions for now.

2. Access the details of the CCE cluster created in step 2, click on the Node Management Menu, then Create Node Group.

3. Refer to the documentation below to set custom parameters and complete the creation of the node group. For parameters not specified in the table, please follow the recommended default values without modification.

When creating a node group, only single-zone or three-zone configurations are supported. If you select a different number of zones, instances cannot be created later.

Parameter Settings	Value Description
Node Group Name	Description: Fill in a distinctive name according to business semantics.
Node Configuration	Description: Specify the node pool model, please refer to the document Overview▸. Fill in the model. Note: AutoMQ must run on specified VM models, and if a non-preset model is selected when creating the node pool, the node pool cannot be used later.
Role Name	Description: The AutoMQ cluster requires access to Object storage, networks, and other cloud services, thus necessitating the authorization of the node pool for these operations. Users must create a separate IAM role and select this newly created IAM role. Note: When creating a dedicated node group for AutoMQ, it is recommended to create a new IAM role. Subsequently, assign the appropriate permissions for this role in the AutoMQ console. Reusing other IAM roles may lead to permission overflow.
Taints	Description: To prevent other workloads within the Kubernetes cluster from occupying resources exclusive to AutoMQ nodes, you need to taint the exclusive node pool for AutoMQ. The taint key is dedicated, the value is automq, and the effect is NO_SCHEDULE.

4. Bind the IAM role information to the node pool, where the role information is from the role name created in the previous step. Also, add taints to the node pool, where the taint key is dedicated, the value is automq, and the effect is NO_SCHEDULE.

5. Click to create the node group.

Step 4: Access the Environment Console and Create the Deployment Configuration

The first time you enter the AutoMQ BYOC console, you need to create a deployment configuration to set up Kubernetes cluster information, bucket information, etc., before creating an instance.

1. Copy the Cluster ID of the CCE cluster created in step 2.

2. Find and view the cluster credentials menu to obtain the Kubeconfig configuration file.

3. Log into the console, enter the Cluster ID and Kubeconfig configurations, and click Next.

   4. Deployment Type: Select Kubernetes.

   5. Kubernetes Cluster: Enter the cluster ID of the CCE cluster.

   6. Kubeconfig: Fill in the content copied in the previous step.

   7. DNS ZoneId: Enter the internal DNS ZoneId used to deploy AutoMQ.

   8. Bucket Name: Specify the data bucket used to store messages for AutoMQ deployment, supporting the addition of multiple BOS buckets.

4. After entering the cloud resource information, generate the required permissions for the data plane CCE node pool. Refer to the console guide, create authorization policy. Then, bind the authorization policy to the AutoMQ IAM role created in Step 3 and record the name of this node pool role, click next to preview.

5. Preview the deployment configuration information and complete the creation. You can then proceed to the instance management page to create an instance.