New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
flink cdc可不可以支持,配置从最早或者最新的地方开始消费数据 #24
Comments
看了下代码,大于1.0.0的版本,可以通过类似下面的设置,避免全表扫描数据,而从最新的数据开始监控。 |
这样设置更简单...... properties.put("snapshot.mode", "schema_only"); SourceFunction sourceFunction = MySQLSource.builder() |
You are right. I have added this to FAQ. Reply here again: This can be controlled by the option
|
可以向canal 那样 消费就提交不会重新消费了 |
老哥 我是用postgresql-cdc按照properties.put("snapshot.mode", "schema_only");这个配置启动的时候会报错 |
现在一个新的flink cdc直接消费mysql表,默认首先会处理历史全量数据,但某些情况下,之前的数据可以不用管,只需要从最新的地方开始消费就可以了。
The text was updated successfully, but these errors were encountered: