DataStream-api-package-guidance#2583
Conversation
According to the pom package, the data can be displayed normally in my cluster. The guava version conflict between flink 1.13 and mysql cdc can be effectively resolved.
|
|
This can run in the cluster, but it can't debug it in IntelliJ IDEA. It will report that gauva 18 can't be found. How to solve it? |
gtk96
force-pushed
the
DataStream_API_package_guidance
branch
from
85a9edd to
7c17421
Compare
|
|
||
| ## frame version | ||
|
|
||
| flink 1.13.6 flink mysql cdc 2.4.1 |
There was a problem hiding this comment.
Flink 1.13 may not be support in the future, you can give an example based on the latest support version.
There was a problem hiding this comment.
You're right, I plan to update it to Flink 1.18 and CDC 2.5.0 in the future, because at this time, many users who do not use Flink 1.18 will be affected by the Guava version upgrade, just like some users who currently use Flink 1.13 and CDC 2.4.1 will be affected by Guava 30 and Guava 18
There was a problem hiding this comment.
Could we list all flink version and give the example in Flink 1.17.2 which is the latest stable version Flink CDC supported ? Btw，we can use mysql cdc 2.4.2 version here.
|
@lvyanquan Can you help me see if there is any problem with the basic pom example? I can easily modify the version. |
|
This may be duplicated with this doc Usage for DataStream API. Not sure whether we should add a new page for maven package. |
|
@lvyanquan This PR aims to telling users how to package a DS project which used flink cdc connectors, like flink shaded guava and mysql driver, these dependenc,ies are different in each flink cdc version. The link you posted just a DS quickstart for each cdc connector DS API, it's not enough to build DS application using flink cdc connectors。 |
|
@gtk96 Maye we can link the guidance to [Usage for DataStream API](https://ververica.github.io/flink-cdc-connectors/master/content/about.html#usage-for-datastream-api） section of each cdc connectors |
We have so many connectors that I can't verify them one by one.😫 |
leonardBang
left a comment
leonardBang
left a comment
There was a problem hiding this comment.
Thanks @gtk96 for the contribution, I left two comments
|
|
||
| ## frame version | ||
|
|
||
| flink 1.13.6 flink mysql cdc 2.4.1 |
There was a problem hiding this comment.
Could we list all flink version and give the example in Flink 1.17.2 which is the latest stable version Flink CDC supported ? Btw，we can use mysql cdc 2.4.2 version here.
leonardBang
left a comment
leonardBang
left a comment
There was a problem hiding this comment.
Thanks @gtk96 and @lvyanquan for the update, LGTM
I will append a commit to add 1.18 support as well
leonardBang
force-pushed
the
DataStream_API_package_guidance
branch
from
7a20661 to
c7e5177
Compare
This closes apache#2583. Co-authored-by: Leonard Xu <leonard@apache.org>
This closes apache#2583. Co-authored-by: Leonard Xu <leonard@apache.org>
3 participants
closed #1729