HDDS-9266. Acceptance test for snapshot data validation after OM bootstrapping

[xBis7]

What changes were proposed in this pull request?

This PR, is adding a new test setup to run under ozonesecure-ha docker env for validating snapshot data installed with a Ratis snapshot under a bootstrapped OM.

The test follows the below steps

• Starts with om3 inactive and uninitialized
• Calls a robot test for creating data, the test:
  • Creates 100 metadata keys
  • Creates snapshot 1
  • Creates 2 actual keys and set the key contents the same as the key name
  • Creates snapshot 2
• Checks that om3 isn't running
• Checks that om3 has no data
• Bootstraps om3
• Checks that om3 is now running
• Checks that om3 has data
• Calls a robot test for validating the data, the test:
  • Waits until checkpoints have been created on om3
  • Checks that om3 isn't the leader
  • Transfer leadership to om3, to perform regular leader reads
  • Checks that the snapshots exist on om3
  • Runs a snapshot diff and validates results
  • Checks key contents

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-9266

How was this patch tested?

This patch is adding new acceptance tests. Two green CI workflows on my fork.

https://github.com/xBis7/ozone/actions/runs/6264845503

https://github.com/xBis7/ozone/actions/runs/6264807295

[hemantk-12]

Thanks for the patch @xBis7

I took a high level view and good addition to CD/CI. Left some minor comments.

[hemantk-12]

LGTM.

[hemantk-12]

Thanks for working on this @xBis7

[xBis7]

Thanks @hemantk-12 for the review and merge.