[Bug] [checkpoint-storage] Checkpoints are only write on the first node and sometimes it may timeout. #7106
Labels
Comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Search before asking
What happened
Build SeaTunnel Engine using three 8u32g servers, but sometimes there may be checkpoint timeout and checkpoints always write to the first node, resulting in too many inode.
SeaTunnel Version
2.3.5
SeaTunnel Config
Running Command
used ds: env { parallelism = 1 job.mode = "STREAMING" checkpoint.interval = 60000 job.name = "z003" } source { MySQL-CDC { base-url = "jdbc:mysql://xxx:3306/xxx?autoReconnect=true" username = "root" password = "xxx" table-names = ["xxx.xxx"] startup.mode = "initial" result_table_name = "source_table_2" query = "select xxx from xxx" } } transform { Sql { source_table_name = "source_table_2" result_table_name = "target_table_2" query = "select xxx from source_table_2" } Sql { source_table_name = "target_table_2" result_table_name = "target_table_log_2" query = "select xxx from target_table_2" } } sink { Jdbc { url = "jdbc:mysql://xxx:3306/xxx?autoReconnect=true" driver= "com.mysql.cj.jdbc.Driver" user = "root" password = "xxx" database = "xxx" source_table_name = "target_table_2" generate_sink_sql = true table = "xxx" batch_size = 10 primary_keys = ["xxx"] } Jdbc { url = "jdbc:mysql://xxx:3306/xxx?autoReconnect=true" driver= "com.mysql.cj.jdbc.Driver" user = "root" password = "xxx" database = "xxx" source_table_name = "target_table_log_2" batch_size = 10 query = "insert into xxx(xxx) values(?) ON DUPLICATE KEY UPDATE field= VALUES(field);" } }Error Exception
Zeta or Flink or Spark Version
Zeta
Java or Scala Version
java version "1.8.0_401"
Java(TM) SE Runtime Environment (build 1.8.0_401-b10)
Java HotSpot(TM) 64-Bit Server VM (build 25.401-b10, mixed mode)
Screenshots
No response
Are you willing to submit PR?
Code of Conduct
The text was updated successfully, but these errors were encountered: