Support embedding a 3.7 broker

[robobario]

Type of change

• Enhancement / new feature

Description

Why:
In Kafka 3.7 the MetaProperties has changed package, so the extension fails with an exception at Runtime when it tries to invoke buildMetadataProperties if we have the 3.7 kafka server on the classpath.

This change will be required when we upgrade the extension to compile against 3.7 to support backwards compatibility with Kafka 3.6

Additional Context

Strimzi are preparing to use Kafka 3.7 and this breaks their tests at runtime as we can no longer start up embedded brokers.

Checklist

Please go through this checklist and make sure all applicable tasks have been done

• Write tests
• Make sure all tests pass
• Update documentation
• Reference relevant issue(s) and close them after merging
• Update CHANGELOG.md

[SamBarker]

Nasty but I'm not sure what else to suggest.

Thanks @robobario

[robobario]

Have tested against the strimzi 3.7 PR branch by running the topic-operator tests against a locally built extension snapshot.

[INFO] Results:
[INFO] 
[WARNING] Tests run: 134, Failures: 0, Errors: 0, Skipped: 1
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  50.779 s
[INFO] Finished at: 2024-01-12T13:39:54+13:00
[INFO] ------------------------------------------------------------------------

[sonarqubecloud]

Quality Gate passed

The SonarCloud Quality Gate passed, but some issues were introduced.

1 New issue
0 Security Hotspots
No data about Coverage
0.0% Duplication on New Code

See analysis details on SonarCloud