Cruise Control STs are failing with older Kafka versions when KRaft is used

[scholzj]

When running some of the Cruise Control STs with older Kafka versions and KRaft, they seem to fail to deploy the Kafka cluster due to the following error:

Kafka namespace-6/my-cluster-a0fb7d24 has invalid spec.kafka.config: inter.broker.protocol.version has value '3.7' which does not match the required pattern: \Q0.8.0\E(\.[0-9]+)*|\Q0.8.0\E|\Q0.8.1\E(\.[0-9]+)*|\Q0.8.1\E|\Q0.8.2\E(\.[0-9]+)*|\Q0.8.2\E|\Q0.9.0\E(\.[0-9]+)*|\Q0.9.0\E|\Q0.10.0\E(\.[0-9]+)*|\Q0.10.0-IV0\E|\Q0.10.0-IV1\E|\Q0.10.1\E(\.[0-9]+)*|\Q0.10.1-IV0\E|\Q0.10.1-IV1\E|\Q0.10.1-IV2\E|\Q0.10.2\E(\.[0-9]+)*|\Q0.10.2-IV0\E|\Q0.11.0\E(\.[0-9]+)*|\Q0.11.0-IV0\E|\Q0.11.0-IV1\E|\Q0.11.0-IV2\E|\Q1.0\E(\.[0-9]+)*|\Q1.0-IV0\E|\Q1.1\E(\.[0-9]+)*|\Q1.1-IV0\E|\Q2.0\E(\.[0-9]+)*|\Q2.0-IV0\E|\Q2.0-IV1\E|\Q2.1\E(\.[0-9]+)*|\Q2.1-IV0\E|\Q2.1-IV1\E|\Q2.1-IV2\E|\Q2.2\E(\.[0-9]+)*|\Q2.2-IV0\E|\Q2.2-IV1\E|\Q2.3\E(\.[0-9]+)*|\Q2.3-IV0\E|\Q2.3-IV1\E|\Q2.4\E(\.[0-9]+)*|\Q2.4-IV0\E|\Q2.4-IV1\E|\Q2.5\E(\.[0-9]+)*|\Q2.5-IV0\E|\Q2.6\E(\.[0-9]+)*|\Q2.6-IV0\E|\Q2.7\E(\.[0-9]+)*|\Q2.7-IV0\E|\Q2.7-IV1\E|\Q2.7-IV2\E|\Q2.8\E(\.[0-9]+)*|\Q2.8-IV0\E|\Q2.8-IV1\E|\Q3.0\E(\.[0-9]+)*|\Q3.0-IV0\E|\Q3.0-IV1\E|\Q3.1\E(\.[0-9]+)*|\Q3.1-IV0\E|\Q3.2\E(\.[0-9]+)*|\Q3.2-IV0\E|\Q3.3\E(\.[0-9]+)*|\Q3.3-IV0\E|\Q3.3-IV1\E|\Q3.3-IV2\E|\Q3.3-IV3\E|\Q3.4\E(\.[0-9]+)*|\Q3.4-IV0\E|\Q3.5\E(\.[0-9]+)*|\Q3.5-IV0\E|\Q3.5-IV1\E|\Q3.5-IV2\E|\Q3.6\E(\.[0-9]+)*|\Q3.6-IV0\E|\Q3.6-IV1\E|\Q3.6-IV2\E

This seems to be caused by the STs using the Cruise Control examples to deploy Kafka. The examples contain the Kafka version and the inter.broker.protocol.version. This does not seem to be updated in the KRaft tests and causes this failure. It seems to work fine in regression / feature-gates-regression where KRaft is not used, so I assume these fields are updated there and should be remvoed or updated for KRaft as well?

The affected tests seem to be:

• ReconciliationST.testPauseReconciliationInKafkaRebalanceAndTopic
• CruiseControlApiST.testCruiseControlBasicAPIRequestsWithSecurityDisabled
• CruiseControlST
• CruiseControlConfigurationST

and possibly some more (as the test run with most of these tests timed out).