[FLINK-35652] Support Custom Data Distribution for Input Stream of Lookup Join

[reswqa]

What is the purpose of the change

Implements FLIP-462: Support Custom Data Distribution for Input Stream of Lookup Join.

Brief change log

• Expose taskinfo in FunctionContext
• Introduce SupportsLookupCustomShuffle interface
• Shuffle input stream of lookup join based on LOOKUP hint

Verifying this change

UT & IT

Does this pull request potentially affect one of the following parts:

• Dependencies (does it add or upgrade a dependency): no
• The public API, i.e., is any changed class annotated with @Public(Evolving): no
• The serializers: no
• The runtime per-record code paths (performance sensitive): no
• Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: no
• The S3 file system connector: no

Documentation

• Does this pull request introduce a new feature? yes
• If yes, how is the feature documented? later PR

[flinkbot]

CI report:

• 7c1e391 Azure: SUCCESS

Bot commands

The @flinkbot bot supports the following commands:

• @flinkbot run azure re-run the last Azure build

[reswqa]

@flinkbot run azure

[yunfengzhou-hub]

Thanks for the PR. Left some comments as below.

[hackergin]

@reswqa Thanks for the contribution, only one minor comment.

[yunfengzhou-hub]

Thanks for the update! LGTM.

[reswqa]

@flinkbot run azure

[xuyangzhong]

This pr is pretty good. LGTM overall.

[reswqa]

Thanks all for the review, merged into master.