[Bug][Sort] Infinite log growth causes insufficient disk space on sort-flink-v1.13(Mysql to Clickhouse)

[XiaoYou201]

What happened

Infinite log growth causes insufficient disk space

When I use inlong mysql cdc to clickhouse(ck), The taskmanager log has abnormal as follow picture description.

The log keeps printing the same message. This message should be printed when There is update or delete operation for ck and should not appear so many times.

When I use inlong web ui to run official test case through docker, several hours later, my disk is full.

But before run mysql to ck test case, my disk has enough space.

What you expected to happen

• Logs should not grow indefinitely.
• Logs should not print out operations that do not exist

The above instructions are only for mysql to clickhouse

How to reproduce

mysql to clickhouse use two module as follow.

Mysql-cdc

I only tested mysql cdc module. It's log has not exception.

JDBC

The inlong use JDBC to connect clickhouse and execute operation(select, insert, update,delete...). I guess the implement of JDBC module has a little problem lead to this bug happen.So, I try to check JDBC module code.

Environment

Ubuntu 22.04
Docker Server Version: 25.0.3

InLong version

master

InLong Component

InLong Sort

Are you willing to submit PR?

• Yes, I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct