Enables Pulsar as Streaming Source and Sink in Flink DataStream

[yjshen]

This PR focus on consuming typed message from Pulsar and produce typed message to Pulsar.

Master Issue: #1

It's consist of the following part:

• FlinkPulsarSource: This enables exactly-once consume as well as topic/partition discovery.
• FlinkPulsarSink: This enables at-least-once when checkpoint is enabled and setFlushOnCheckpoint set to true
• PulsarDeserializer and PulsarSerializer: These two come from the counterpart of pulsar-spark-connector, with adaption to Flink's type system
• PulsarMetadataReader: This comes from pulsar-spark-connector too, provides the ability to preserve and commit message, topic match and find, schema get and upload.

[sijie]

remove this or create an issue for tracking a fix for this?

[yjshen]

Opened an issue to track this.

[sijie]

Do we have the case insensitive issue as what we had in Spark?

[yjshen]

I'll add a test case for this, opened an issue.

[sijie]

[�[1;33mWARNING�[m] [Warn] : bootstrap class path not set in conjunction with -source 1.6
[�[1;31mERROR�[m] [Error] /home/jenkins/workspace/StreamNative_pulsar-flink_PR-4/src/test/java/org/apache/flink/streaming/connectors/pulsar/internal/ClosableBlockingQueueTest.java:38: diamond operator is not supported in -source 1.6
  (use -source 7 or higher to enable diamond operator)
[�[1;31mERROR�[m] [Error] /home/jenkins/workspace/StreamNative_pulsar-flink_PR-4/src/test/scala/org/apache/flink/streaming/connectors/pulsar/testutils/TestSourceContext.java:30: diamond operator is not supported in -source 1.6
  (use -source 7 or higher to enable diamond operator)

@yjshen can you please talk a look at the CI failure?

[yjshen]

[�[1;33mWARNING�[m] [Warn] : bootstrap class path not set in conjunction with -source 1.6
[�[1;31mERROR�[m] [Error] /home/jenkins/workspace/StreamNative_pulsar-flink_PR-4/src/test/java/org/apache/flink/streaming/connectors/pulsar/internal/ClosableBlockingQueueTest.java:38: diamond operator is not supported in -source 1.6
  (use -source 7 or higher to enable diamond operator)
[�[1;31mERROR�[m] [Error] /home/jenkins/workspace/StreamNative_pulsar-flink_PR-4/src/test/scala/org/apache/flink/streaming/connectors/pulsar/testutils/TestSourceContext.java:30: diamond operator is not supported in -source 1.6
  (use -source 7 or higher to enable diamond operator)

@yjshen can you please talk a look at the CI failure?

Done.