Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[MySQL] Caused by: io.debezium.DebeziumException: Received DML xxx binlog probably contains events generated with statement or mixed based replication format #1017

Closed
yangrong688 opened this issue Mar 28, 2022 · 5 comments
Labels
bug Something isn't working

Comments

@yangrong688
Copy link

yangrong688 commented Mar 28, 2022

Describe the bug(Please use English)
Binlog will have mixed replcation format when Cloud db like CDB HA transition and send statement format replication to binlog
In debezium 1.5.4 Final, it will fail and cannot restore from checkpoint when ocurring DB HA transition, we should cherry pick debezium/debezium#3319 this pr to solve this problem.

Environment :

  • Flink version : 1.13.3
  • Flink CDC version: 2.1.0
  • Database and version: MySQL 5.7

To Reproduce
Steps to reproduce the behavior:

  1. Thes test data :
  2. The test code :
  3. The error :
    Caused by: io.debezium.DebeziumException: Received DML 'DELETE FROM _cdbcksum__329_124080501_1648309680.checksums WHERE db = 'xx' AND tbl = 'a'' for processing, binlog probably contains events generated with statement or mixed based replication format at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleQueryEvent(MySqlStreamingChangeEventSource.java:556) ~[flink-sql-connector-mysql-cdc-2.1.1.jar:2.1.1] at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleEvent(MySqlStreamingChangeEventSource.java:352) ~[flink-sql-connector-mysql-cdc-2.1.1.jar:2.1.1] at com.ververica.cdc.connectors.mysql.debezium.task.MySqlBinlogSplitReadTask.handleEvent(MySqlBinlogSplitReadTask.java:94) ~[flink-sql-connector-mysql-cdc-2.1.1.jar:2.1.1] at com.github.shyiko.mysql.binlog.BinaryLogClient.notifyEventListeners(BinaryLogClient.java:1118) ~[flink-sql-connector-mysql-cdc-2.1.1.jar:2.1.1] at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:966) ~[flink-sql-connector-mysql-cdc-2.1.1.jar:2.1.1] at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:606) ~[flink-sql-connector-mysql-cdc-2.1.1.jar:2.1.1] at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:850) ~[flink-sql-connector-mysql-cdc-2.1.1.jar:2.1.1] ... 1 more

Additional Description
If applicable, add screenshots to help explain your problem.

@yangrong688 yangrong688 added the bug Something isn't working label Mar 28, 2022
@yangrong688
Copy link
Author

@leonardBang shall we fix this issue like we did in #911

@leonardBang
Copy link
Contributor

@yangrong688 I think we can fix this in flink cdc code, If we want to use debezium's PR I tend to bump debezium version to fix the issue.

@yangrong688
Copy link
Author

@yangrong688 I think we can fix this in flink cdc code, If we want to use debezium's PR I tend to bump debezium version to fix the issue.

OK, I will try to commit a pr to fix this in flink cdc code.

@ruanhang1993
Copy link
Contributor

This issue will be fixed by #1236.

@PatrickRen
Copy link
Contributor

Closing this issue because it was created before version 2.3.0 (2022-11-10). Please try the latest version of Flink CDC to see if the issue has been resolved. If the issue is still valid, kindly report it on Apache Jira under project Flink with component tag Flink CDC. Thank you!

@PatrickRen PatrickRen closed this as not planned Won't fix, can't repro, duplicate, stale Feb 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
4 participants