KAFKA-14491: [22/N] Add test for manual upgrade to versioned store

[vcrfxia]

This PR adds an integration test for the manual upgrade scenario to upgrade a non-versioned store to a versioned store. The procedure is outlined in KIP-889 and also in the docs added in #13444:

• stop all app instances
• delete local state store
• update changelog topic configs (done beforehand in the test, to ensure no premature compaction of data)
• restart app with new code for versioned stores.

Committer Checklist (excluded from commit message)

• Verify design and implementation
• Verify test coverage and CI build status
• Verify documentation (including upgrade notes)

[mjsax]

The docs (pre PR) might also be affected, but we do support upgrade even from plain KV-stores? If yes, we should test it, too, if no, we should be explicit in the docs.

[vcrfxia]

Yeah, as long as the changelog topic format is the same it'll work, which means non-timestamped stores are eligible for upgrade too. Added an additional test.

The docs PR just says "non-versioned" right now (no mention of timestamped vs non-timestamped). I can add a line to make it clear that upgrading from both timestamped and non-timestamped stores are supported.

[mjsax]

I can add a line to make it clear that upgrading from both timestamped and non-timestamped stores are supported.

Sounds like a good idea. Thx.

[mjsax]

FAILURE: Build failed with an exception.
[2023-03-28T21:07:13.365Z] 
[2023-03-28T21:07:13.365Z] * What went wrong:
[2023-03-28T21:07:13.365Z] A problem was found with the configuration of task ':rat' (type 'RatTask').
[2023-03-28T21:07:13.365Z]   - Gradle detected a problem with the following location: '/home/jenkins/workspace/Kafka_kafka-pr_PR-13449'.
[2023-03-28T21:07:13.365Z]     
[2023-03-28T21:07:13.365Z]     Reason: Task ':rat' uses this output of task ':clients:processTestMessages' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed.
[2023-03-28T21:07:13.365Z]     
[2023-03-28T21:07:13.365Z]     Possible solutions:
[2023-03-28T21:07:13.365Z]       1. Declare task ':clients:processTestMessages' as an input of ':rat'.
[2023-03-28T21:07:13.365Z]       2. Declare an explicit dependency on ':clients:processTestMessages' from ':rat' using Task#dependsOn.
[2023-03-28T21:07:13.365Z]       3. Declare an explicit dependency on ':clients:processTestMessages' from ':rat' using Task#mustRunAfter.

Not 100% sure what this means. Will retrigger Jenkins to see if it goes away.