Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

基于明确的I/U/D是否过滤 #3452

Merged
merged 4 commits into from Apr 19, 2021
Merged

基于明确的I/U/D是否过滤 #3452

merged 4 commits into from Apr 19, 2021

Conversation

suman-lee
Copy link
Contributor

在某些边缘计算业务场景,边缘节点的delete操作主要用来数据备份,不过滤的话会导致正常add和update数据处理延时(数据量大的话延时可以达到10几分钟)。

@CLAassistant
Copy link

CLAassistant commented Apr 13, 2021

CLA assistant check
All committers have signed the CLA.

@agapple
Copy link
Member

agapple commented Apr 17, 2021

support是check的逻辑,如果是数据过滤设计上用

canal.instance.filter.dml.insert=false
canal.instance.filter.dml.update=false
canal.instance.filter.dml.delete=false

基于明确的I/U/D是否过滤来提交一个PR吧

@suman-lee suman-lee changed the title dmls filter 基于明确的I/U/D是否过滤 Apr 17, 2021
@agapple agapple merged commit 21904ef into alibaba:master Apr 19, 2021
@agapple
Copy link
Member

agapple commented Apr 19, 2021

tks

@godchou
Copy link

godchou commented May 27, 2021

感觉设计的不是很好,我们对dml的过滤需要细化到表级别的;因为有些表定期会归档

@suman-lee
Copy link
Contributor Author

感觉设计的不是很好,我们对dml的过滤需要细化到表级别的;因为有些表定期会归档

表过滤用canal.instance.filter.black.regex这个配置项

@ganjialong
Copy link

感觉设计的不是很好,我们对dml的过滤需要细化到表级别的;因为有些表定期会归档

表过滤用canal.instance.filter.black.regex这个配置项

es父子文档结构,mysql删除子表数据时,对应的es子文档数据不会删除,这个有什么好的解决方案?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants