[HUDI-5205] Support Flink 1.16.0

[stayrascal]

Change Logs

• support flink 1.16.0
• Based on PR
  • copy the existing adapters from hudi-flink1.15.x to hudi-flink1.16.x
  • Add new adapters StreamWriteOperatorCoordinatorAdapter & SortOperatorGenAdapter in each flink module
  • add flink1.16 profile in ci matrix

Impact

Low

Risk level (write none, low medium or high below)

Low

Documentation Update

the official documents need to be updated

Contributor's checklist

• Read through contributor's guide
• Change Logs and Impact were stated clearly
• Adequate tests were added if applicable
• CI passed

[danny0405]

Rename the clazz to OperatorCoordinatorAdapter, the license header is also missing.

[stayrascal]

got it.

[danny0405]

Thanks for the contribution, I have reviewed and applied a patch here:
5205.zip

You can apply the patch with cmd: git apply ${patch_path}
Then force push the branch with cmd: git push ${branch_name} --force.

[rahil-c]

@stayrascal @danny0405 Thanks for making this change, just to confirm this is targeted for Hudi 0.13.0?

[stayrascal]

Thanks for the contribution, I have reviewed and applied a patch here: 5205.zip

You can apply the patch with cmd: git apply ${patch_path} Then force push the branch with cmd: git push ${branch_name} --force.

Thanks a lot for reviewing this PR, will apply this patch.
BTW, there are some IT cases failed by NPE, still need fix the issues later.

[stayrascal]

@stayrascal @danny0405 Thanks for making this change, just to confirm this is targeted for Hudi 0.13.0?

Currently, this change is targeted to master branch(0.13.0), but in my case, I will apply this change in old version(0.11.1 or 0.12) once everything passed, is there any concern or blockers about apply this change to older version?

[danny0405]

Thanks for the contribution, I have reviewed again and created another patch:
5205.patch.zip

The tests failed because the JsonRowDataDeserializationSchema is refactorted where the #open method must be called for some JSON infrustructures initialization.

[hudi-bot]

CI report:

• 214fa61 UNKNOWN
• a36478d Azure: FAILURE

Bot commands

@hudi-bot supports the following commands:

• @hudi-bot run azure re-run the last Azure build

[danny0405]

+1

[melin]

upgrade flink version 1.16.1 @danny0405