doc-exports/docs/dms/umn/kafka-ug-0006.html
Chen, Junjie ca9677b121 DMS UMN 20230201 Version
Reviewed-by: Antonova, Ekaterina <ekantono@noreply.gitea.eco.tsi-dev.otc-service.com>
Co-authored-by: Chen, Junjie <chenjunjie@huawei.com>
Co-committed-by: Chen, Junjie <chenjunjie@huawei.com>
2024-07-22 13:20:04 +00:00

6.8 KiB

Changing Kafka Partition Quantity

After creating a topic, you can increase the number of partitions as required.

Changing the number of partitions does not restart the instance or affect services.

Methods for changing the partition quantity:

Method 1: By using Kafka console

  1. Log in to the console.
  2. Click in the upper left corner to select a region.

    Select the region where your Kafka instance is located.

  3. Click Service List and choose Application > Distributed Message Service. The Kafka instance list is displayed.
  4. Click the desired Kafka instance to view the instance details.
  5. In the navigation pane, choose Topics.
  6. Modify the number of partitions using either of the following methods:

    • Select one or more topics and click Edit Topic in the upper left corner.
    • In the row containing the desired topic, click Edit.

  7. In the Edit Topic dialog box, enter the number of partitions and click OK.

    • The number of partitions can only be increased.
    • To ensure performance, the Kafka console allows a maximum of 200 partitions for each topic.
    • The total number of partitions of all topics cannot exceed the maximum number of partitions allowed by the instance.

Method 2: By Using Kafka CLI

If your Kafka client version is later than 2.2, you can use kafka-topics.sh to change the partition quantity.

For an instance with ciphertext access enabled, if allow.everyone.if.no.acl.found is set to false, topic partition quantity cannot be modified through the client.

  • For a Kafka instance with ciphertext access disabled, run the following command in the /bin directory of the Kafka client:
    ./kafka-topics.sh --bootstrap-server ${connection-address} --topic ${topic-name} --alter --partitions ${number-of-partitions}
  • For a Kafka instance with ciphertext access enabled, do as follows:
    1. (Optional) For the Kafka security protocol, is SASL_PLAINTEXT or SASL_SSL used?
      • SASL_PLAINTEXT: Skip this step if the username and password are already set. In other cases, create the ssl-user-config.properties file in the /config directory of the Kafka client. Add the username and password by referring to 3.
      • SASL_SSL: Skip this step if the username, password, and SSL certificate are already set. In other cases, create the ssl-user-config.properties file in the /config directory of the Kafka client. Add the username and password, and the SSL certificate configuration by referring to 3.
    2. Run the following command in the /bin directory of the Kafka client:
      ./kafka-topics.sh --bootstrap-server ${connection-address} --topic ${topic-name} --alter --partitions ${number-of-partitions} --command-config ./config/ssl-user-config.properties