Support for upgrading Zookeeper and Broker components

[rmarting]

SUMMARY

Kafka allows upgrading components with no downtime following a rolling strategy for each component of the Zk+Bk deployment. The collecion should provide the capabillity to upgrade a deployment from one version to another one in a simple way, implementing that strategy.

It is important to keep in mind the versions involved during the upgrade as they define the message format in the kafka topics. Kafka’s log message format version and inter-broker protocol version specify, respectively, the log format version appended to messages and the version of the Kafka protocol used in a cluster. To ensure the correct versions are used, the upgrade process involves making configuration changes to existing Kafka brokers and code changes to client applications (consumers and producers).

NOTE: The collection will not cover the upgrade of the Kafka clients, as they are not part of the Kafka topology.

The collection should identify an upgrade process for a newer version and execute the process described here.

References:

• AMQ Streams - Upgrading Kafka
• AMQ Streams - Upgrading Zk and Bk components

ISSUE TYPE

• Feature Idea