Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] [Connector-V2 JDBC] source读取数据为空时,java.lang.NullPointerException #6013

Closed
2 of 3 tasks
jochenshen24 opened this issue Dec 15, 2023 · 4 comments
Closed
2 of 3 tasks

Comments

@jochenshen24
Copy link

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

增量同步数据从mysql到mysql, source端数据没有数据时,报java.lang.NullPointerException异常;
确认用增量条件在源端查询时没有数据。

希望的结果是程序正常结束,统计数据中读写数据为0;
配置文件中增加partition_lower_bound和partition_upper_bound配置时达到希望的结果;但实际应用中不明确参数应该配置什么值 。

SeaTunnel Version

2.3.3

SeaTunnel Config

env {
  execution.parallelism = 2
  job.mode = "BATCH"
}

source {
  Jdbc {
      driver = "com.mysql.cj.jdbc.Driver"
      url = "jdbc:mysql://192.168.0.10:3306/test1?useUnicode=true&characterEncoding=utf8&useSSL=false&allowPublicKeyRetrieval=true"
      user = "username"
      password = "password"

      partition_column = "id"
      partition_num = 2
      query = "select * from t_base where id>"${var}""
  }
}

sink {
  Jdbc {
    driver = "com.mysql.cj.jdbc.Driver"
    url = "jdbc:mysql://192.168.0.32:3306/test?useUnicode=true&characterEncoding=utf8&useSSL=false"
    user = "username"
    password = "password"
    database = "test"
    table = "t_base"
    primary_keys = id
    support_upsert_by_query_primary_key_exist=true
    batch_size = 1000
    connection_check_timeout_sec=30
    generate_sink_sql=true
  }
}

Running Command

bin/seatunnel.sh --config /data/applications/seatunnel_data/mysql2mysql.config -m local -i var=2355

Error Exception

2023-12-15 17:35:28,597 INFO  com.hazelcast.internal.diagnostics.Diagnostics - [localhost]:5801 [seatunnel-274994] [5.1] Diagnostics disabled. To enable add -Dhazelcast.diagnostics.enabled=true to the JVM arguments.
2023-12-15 17:35:28,605 INFO  com.hazelcast.core.LifecycleService - [localhost]:5801 [seatunnel-274994] [5.1] [localhost]:5801 is STARTING
2023-12-15 17:35:28,651 INFO  com.hazelcast.internal.cluster.impl.TcpIpJoiner - [localhost]:5801 [seatunnel-274994] [5.1] [localhost]:5819 is added to the blacklist.
2023-12-15 17:35:29,666 INFO  com.hazelcast.internal.cluster.ClusterService - [localhost]:5801 [seatunnel-274994] [5.1] 

2023-12-15 17:35:31,638 INFO  org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask - received reader register, readerID: TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=30000}, taskID=40000, index=0}
2023-12-15 17:35:31,692 INFO  org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask - received enough reader, starting enumerator...
2023-12-15 17:35:31,693 INFO  org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator - Starting to calculate splits.
2023-12-15 17:35:31,693 WARN  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] Exception in org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask@68c9d5de
java.lang.NullPointerException: null
        at org.apache.seatunnel.connectors.seatunnel.jdbc.internal.split.JdbcNumericBetweenParametersProvider.<init>(JdbcNumericBetweenParametersProvider.java:57) ~[connector-jdbc-2.3.3.jar:2.3.3]
        at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator.discoverySplits(JdbcSourceSplitEnumerator.java:118) ~[connector-jdbc-2.3.3.jar:2.3.3]
        at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator.run(JdbcSourceSplitEnumerator.java:87) ~[connector-jdbc-2.3.3.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.stateProcess(SourceSplitEnumeratorTask.java:303) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.call(SourceSplitEnumeratorTask.java:134) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:613) [seatunnel-starter.jar:2.3.3]
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_391]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_391]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_391]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_391]
        at java.lang.Thread.run(Thread.java:750) [?:1.8.0_391]
2023-12-15 17:35:31,699 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] taskDone, taskId = 20000, taskGroup = TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=1}
2023-12-15 17:35:31,700 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] Task TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=1} complete with state FAILED
2023-12-15 17:35:31,701 INFO  org.apache.seatunnel.engine.server.CoordinatorService - [localhost]:5801 [seatunnel-274994] [5.1] Received task end from execution TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=1}, state FAILED
2023-12-15 17:35:31,703 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] turn to end state FAILED.
2023-12-15 17:35:31,703 ERROR org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] end with state FAILED and Exception: java.lang.NullPointerException
        at org.apache.seatunnel.connectors.seatunnel.jdbc.internal.split.JdbcNumericBetweenParametersProvider.<init>(JdbcNumericBetweenParametersProvider.java:57)
        at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator.discoverySplits(JdbcSourceSplitEnumerator.java:118)
        at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator.run(JdbcSourceSplitEnumerator.java:87)
        at org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.stateProcess(SourceSplitEnumeratorTask.java:303)
        at org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.call(SourceSplitEnumeratorTask.java:134)
        at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:613)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:750)

2023-12-15 17:35:31,703 ERROR org.apache.seatunnel.engine.server.dag.physical.SubPlan - Task TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=1} Failed in Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], Begin to cancel other tasks in this pipeline.
2023-12-15 17:35:31,703 WARN  org.apache.seatunnel.engine.server.dag.physical.SubPlan - start cancel job Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)] count = 0
2023-12-15 17:35:31,704 INFO  org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)] turn from state RUNNING to CANCELING.
2023-12-15 17:35:31,705 INFO  org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator - start clean pending checkpoint cause Pipeline turn to end state.
2023-12-15 17:35:31,779 INFO  org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)] turn from state DEPLOYING to RUNNING.
2023-12-15 17:35:31,893 INFO  org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask - received reader register, readerID: TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=30000}, taskID=40000, index=0}
2023-12-15 17:35:31,958 INFO  org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask - received enough reader, starting enumerator...
2023-12-15 17:35:31,958 INFO  org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator - Starting to calculate splits.
2023-12-15 17:35:31,959 WARN  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] Exception in org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask@2783b289
java.lang.NullPointerException: null
        at org.apache.seatunnel.connectors.seatunnel.jdbc.internal.split.JdbcNumericBetweenParametersProvider.<init>(JdbcNumericBetweenParametersProvider.java:57) ~[connector-jdbc-2.3.3.jar:2.3.3]
        at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator.discoverySplits(JdbcSourceSplitEnumerator.java:118) ~[connector-jdbc-2.3.3.jar:2.3.3]
        at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator.run(JdbcSourceSplitEnumerator.java:87) ~[connector-jdbc-2.3.3.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.stateProcess(SourceSplitEnumeratorTask.java:303) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.call(SourceSplitEnumeratorTask.java:134) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:613) [seatunnel-starter.jar:2.3.3]
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_391]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_391]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_391]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_391]
        at java.lang.Thread.run(Thread.java:750) [?:1.8.0_391]
2023-12-15 17:35:31,960 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] taskDone, taskId = 20000, taskGroup = TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=1}
2023-12-15 17:35:31,960 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] Task TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=1} complete with state FAILED
2023-12-15 17:35:31,960 INFO  org.apache.seatunnel.engine.server.CoordinatorService - [localhost]:5801 [seatunnel-274994] [5.1] Received task end from execution TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=1}, state FAILED
2023-12-15 17:35:31,962 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] turn to end state FAILED.
2023-12-15 17:35:31,962 ERROR org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] end with state FAILED and Exception: java.lang.NullPointerException
        at org.apache.seatunnel.connectors.seatunnel.jdbc.internal.split.JdbcNumericBetweenParametersProvider.<init>(JdbcNumericBetweenParametersProvider.java:57)
        at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator.discoverySplits(JdbcSourceSplitEnumerator.java:118)
        at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator.run(JdbcSourceSplitEnumerator.java:87)
        at org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.stateProcess(SourceSplitEnumeratorTask.java:303)
        at org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.call(SourceSplitEnumeratorTask.java:134)
        at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:613)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:750)

2023-12-15 17:35:31,962 ERROR org.apache.seatunnel.engine.server.dag.physical.SubPlan - Task TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=1} Failed in Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], Begin to cancel other tasks in this pipeline.
2023-12-15 17:35:31,962 WARN  org.apache.seatunnel.engine.server.dag.physical.SubPlan - start cancel job Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)] count = 0
2023-12-15 17:35:32,204 INFO  org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask - received enough reader, starting enumerator...
2023-12-15 17:35:32,204 INFO  org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator - Starting to calculate splits.
2023-12-15 17:35:32,205 WARN  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] Exception in org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask@1c3dffa0
java.lang.NullPointerException: null
        at org.apache.seatunnel.connectors.seatunnel.jdbc.internal.split.JdbcNumericBetweenParametersProvider.<init>(JdbcNumericBetweenParametersProvider.java:57) ~[connector-jdbc-2.3.3.jar:2.3.3]
        at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator.discoverySplits(JdbcSourceSplitEnumerator.java:118) ~[connector-jdbc-2.3.3.jar:2.3.3]
        at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator.run(JdbcSourceSplitEnumerator.java:87) ~[connector-jdbc-2.3.3.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.stateProcess(SourceSplitEnumeratorTask.java:303) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.call(SourceSplitEnumeratorTask.java:134) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:613) [seatunnel-starter.jar:2.3.3]
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_391]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_391]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_391]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_391]
        at java.lang.Thread.run(Thread.java:750) [?:1.8.0_391]
2023-12-15 17:35:32,205 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] taskDone, taskId = 20000, taskGroup = TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=1}
2023-12-15 17:35:32,205 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] Task TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=1} complete with state FAILED
2023-12-15 17:35:32,206 INFO  org.apache.seatunnel.engine.server.CoordinatorService - [localhost]:5801 [seatunnel-274994] [5.1] Received task end from execution TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=1}, state FAILED
2023-12-15 17:35:32,206 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] turn to end state FAILED.
2023-12-15 17:35:32,206 ERROR org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] end with state FAILED and Exception: java.lang.NullPointerException
        at org.apache.seatunnel.connectors.seatunnel.jdbc.internal.split.JdbcNumericBetweenParametersProvider.<init>(JdbcNumericBetweenParametersProvider.java:57)
        at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator.discoverySplits(JdbcSourceSplitEnumerator.java:118)
        at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator.run(JdbcSourceSplitEnumerator.java:87)
        at org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.stateProcess(SourceSplitEnumeratorTask.java:303)
        at org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.call(SourceSplitEnumeratorTask.java:134)
        at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:613)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:750)

2023-12-15 17:35:32,207 ERROR org.apache.seatunnel.engine.server.dag.physical.SubPlan - Task TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=1} Failed in Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], Begin to cancel other tasks in this pipeline.
2023-12-15 17:35:32,207 WARN  org.apache.seatunnel.engine.server.dag.physical.SubPlan - start cancel job Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)] count = 0
2023-12-15 17:35:32,207 INFO  org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)] turn from state RUNNING to CANCELING.
2023-12-15 17:35:32,208 INFO  org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator - start clean pending checkpoint cause Pipeline turn to end state.
2023-12-15 17:35:32,209 INFO  org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator - Turn checkpoint_state_787976049127325697_1 state from RUNNING to CANCELED
2023-12-15 17:35:32,209 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] state from CREATED to CANCELED
2023-12-15 17:35:32,209 WARN  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - The task Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] state in Imap is RUNNING, not equals expected state CREATED
2023-12-15 17:35:32,209 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] state from SCHEDULED to CANCELED
2023-12-15 17:35:32,209 WARN  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - The task Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] state in Imap is RUNNING, not equals expected state SCHEDULED
2023-12-15 17:35:32,209 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] state from DEPLOYING to CANCELED
2023-12-15 17:35:32,210 WARN  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - The task Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] state in Imap is RUNNING, not equals expected state DEPLOYING
2023-12-15 17:35:32,210 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] state from RUNNING to CANCELING
2023-12-15 17:35:32,210 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] turn from state RUNNING to CANCELING.
2023-12-15 17:35:32,212 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Send cancel Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] operator to member [localhost]:5801
2023-12-15 17:35:32,212 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] Task (TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=30000}) need cancel.
2023-12-15 17:35:32,212 WARN  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] Interrupted task 40000 - org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask@78c1ec02
2023-12-15 17:35:32,212 WARN  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] Interrupted task 50000 - org.apache.seatunnel.engine.server.task.TransformSeaTunnelTask@1b6d6396
2023-12-15 17:35:32,212 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] taskDone, taskId = 40000, taskGroup = TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=30000}
2023-12-15 17:35:32,212 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] taskDone, taskId = 50000, taskGroup = TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=30000}
2023-12-15 17:35:32,212 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] Task TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=30000} complete with state CANCELED
2023-12-15 17:35:32,212 INFO  org.apache.seatunnel.engine.server.CoordinatorService - [localhost]:5801 [seatunnel-274994] [5.1] Received task end from execution TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=30000}, state CANCELED
2023-12-15 17:35:32,213 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] turn to end state CANCELED.
2023-12-15 17:35:32,213 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] end with state CANCELED
2023-12-15 17:35:32,213 INFO  org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)] end with state FAILED
2023-12-15 17:35:32,215 INFO  org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)] turn to end state FAILED.
2023-12-15 17:35:32,215 INFO  org.apache.seatunnel.engine.server.dag.physical.SubPlan - Restore time 3, pipeline Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)]
2023-12-15 17:35:32,215 INFO  org.apache.seatunnel.engine.server.dag.physical.SubPlan - Reset pipeline Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)] state to CREATED
2023-12-15 17:35:32,215 INFO  org.apache.seatunnel.engine.server.dag.physical.SubPlan - Reset pipeline Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)] state to CREATED complete
2023-12-15 17:35:32,216 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] turn to state CREATED.
2023-12-15 17:35:32,217 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] turn to state CREATED.
2023-12-15 17:35:32,217 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - The task Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] is in state CREATED when init state future
2023-12-15 17:35:32,217 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - The task Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] is in state CREATED when init state future
2023-12-15 17:35:32,217 INFO  org.apache.seatunnel.engine.server.checkpoint.CheckpointManager - reported pipeline running stack: [java.lang.Thread.getStackTrace(Thread.java:1564), org.apache.seatunnel.engine.server.checkpoint.CheckpointManager.reportedPipelineRunning(CheckpointManager.java:175), org.apache.seatunnel.engine.server.dag.physical.SubPlan.restorePipeline(SubPlan.java:579), org.apache.seatunnel.engine.server.dag.physical.SubPlan.lambda$addPhysicalVertexCallBack$2(SubPlan.java:208), java.util.concurrent.CompletableFuture.uniAccept(CompletableFuture.java:670), java.util.concurrent.CompletableFuture$UniAccept.tryFire(CompletableFuture.java:646), java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:456), java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149), java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624), java.lang.Thread.run(Thread.java:750)]
2023-12-15 17:35:32,217 INFO  org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator - received restore CheckpointCoordinator with alreadyStarted= false
2023-12-15 17:35:32,218 INFO  org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator - Turn checkpoint_state_787976049127325697_1 state from CANCELED to RUNNING
2023-12-15 17:35:32,218 INFO  org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator - start clean pending checkpoint cause CheckpointCoordinator reset.
2023-12-15 17:35:32,218 INFO  org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)] turn from state CREATED to SCHEDULED.
2023-12-15 17:35:32,219 INFO  org.apache.seatunnel.engine.server.resourcemanager.AbstractResourceManager - received slot active check success, profile: SlotProfile{worker=[localhost]:5801, slotID=1, ownerJobID=787976049127325697, assigned=true, resourceProfile=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=0}}, sequence='e8de8c4b-4c33-4446-ba1a-8e1ac0a9bafb'}
2023-12-15 17:35:32,219 INFO  org.apache.seatunnel.engine.server.scheduler.PipelineBaseScheduler - use active old profile: SlotProfile{worker=[localhost]:5801, slotID=1, ownerJobID=787976049127325697, assigned=true, resourceProfile=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=0}}, sequence='e8de8c4b-4c33-4446-ba1a-8e1ac0a9bafb'} for task Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)]
2023-12-15 17:35:32,219 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] state from CREATED to SCHEDULED
2023-12-15 17:35:32,220 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] turn from state CREATED to SCHEDULED.
2023-12-15 17:35:32,220 INFO  org.apache.seatunnel.engine.server.resourcemanager.AbstractResourceManager - received slot active check success, profile: SlotProfile{worker=[localhost]:5801, slotID=2, ownerJobID=787976049127325697, assigned=true, resourceProfile=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=0}}, sequence='e8de8c4b-4c33-4446-ba1a-8e1ac0a9bafb'}
2023-12-15 17:35:32,220 INFO  org.apache.seatunnel.engine.server.scheduler.PipelineBaseScheduler - use active old profile: SlotProfile{worker=[localhost]:5801, slotID=2, ownerJobID=787976049127325697, assigned=true, resourceProfile=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=0}}, sequence='e8de8c4b-4c33-4446-ba1a-8e1ac0a9bafb'} for task Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)]
2023-12-15 17:35:32,220 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] state from CREATED to SCHEDULED
2023-12-15 17:35:32,220 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] turn from state CREATED to SCHEDULED.
2023-12-15 17:35:32,221 INFO  org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)] turn from state SCHEDULED to DEPLOYING.
2023-12-15 17:35:32,226 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] state from SCHEDULED to DEPLOYING
2023-12-15 17:35:32,227 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] turn from state SCHEDULED to DEPLOYING.
2023-12-15 17:35:32,227 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] state from SCHEDULED to DEPLOYING
2023-12-15 17:35:32,227 INFO  org.apache.seatunnel.connectors.seatunnel.jdbc.internal.executor.FieldNamedPreparedStatement - PrepareStatement sql is:
INSERT INTO `test`.`t_base` (`id`, `created_by`, `created_time`, `updated_by`, `updated_time`, `is_delete`, `district_code`, `name`, `sort`) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?) ON DUPLICATE KEY UPDATE `id`=VALUES(`id`), `created_by`=VALUES(`created_by`), `created_time`=VALUES(`created_time`), `updated_by`=VALUES(`updated_by`), `updated_time`=VALUES(`updated_time`), `is_delete`=VALUES(`is_delete`), `district_code`=VALUES(`district_code`), `name`=VALUES(`name`), `sort`=VALUES(`sort`)

2023-12-15 17:35:32,227 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] turn from state SCHEDULED to DEPLOYING.
2023-12-15 17:35:32,228 INFO  org.apache.seatunnel.connectors.seatunnel.jdbc.internal.executor.FieldNamedPreparedStatement - PrepareStatement sql is:
DELETE FROM `test`.`t_base` WHERE `id` = ?

2023-12-15 17:35:32,228 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] received deploying task executionId [787976055175905281]
2023-12-15 17:35:32,231 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] received deploying task executionId [787976055175970817]
2023-12-15 17:35:32,243 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] deploying task TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=1}, executionId [787976055175970817]
2023-12-15 17:35:32,243 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] deploying TaskGroup TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=1} init success
2023-12-15 17:35:32,244 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] deploying task TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=30000}, executionId [787976055175905281]
2023-12-15 17:35:32,244 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] deploying TaskGroup TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=1} success
2023-12-15 17:35:32,244 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] state from DEPLOYING to RUNNING
2023-12-15 17:35:32,244 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] deploying TaskGroup TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=30000} init success
2023-12-15 17:35:32,245 INFO  org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask - starting seatunnel source split enumerator task, source name: pipeline-1 [Source[0]-Jdbc-default-identifier]
2023-12-15 17:35:32,248 INFO  org.apache.seatunnel.engine.server.task.TransformSeaTunnelTask - starting seatunnel transform task, index 0
2023-12-15 17:35:32,248 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] deploying TaskGroup TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=30000} success
2023-12-15 17:35:32,248 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] state from DEPLOYING to RUNNING
2023-12-15 17:35:32,249 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] turn from state DEPLOYING to RUNNING.
2023-12-15 17:35:32,249 INFO  org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask - starting seatunnel source task, index 0
2023-12-15 17:35:32,251 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] turn from state DEPLOYING to RUNNING.
2023-12-15 17:35:32,253 INFO  org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)] turn from state DEPLOYING to RUNNING.
2023-12-15 17:35:32,381 INFO  org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask - received reader register, readerID: TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=30000}, taskID=40000, index=0}
2023-12-15 17:35:32,449 INFO  org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask - received enough reader, starting enumerator...
2023-12-15 17:35:32,449 INFO  org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator - Starting to calculate splits.
2023-12-15 17:35:32,450 WARN  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] Exception in org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask@19ec4f73
java.lang.NullPointerException: null
        at org.apache.seatunnel.connectors.seatunnel.jdbc.internal.split.JdbcNumericBetweenParametersProvider.<init>(JdbcNumericBetweenParametersProvider.java:57) ~[connector-jdbc-2.3.3.jar:2.3.3]
        at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator.discoverySplits(JdbcSourceSplitEnumerator.java:118) ~[connector-jdbc-2.3.3.jar:2.3.3]
        at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator.run(JdbcSourceSplitEnumerator.java:87) ~[connector-jdbc-2.3.3.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.stateProcess(SourceSplitEnumeratorTask.java:303) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.call(SourceSplitEnumeratorTask.java:134) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:613) [seatunnel-starter.jar:2.3.3]
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_391]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_391]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_391]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_391]
        at java.lang.Thread.run(Thread.java:750) [?:1.8.0_391]
2023-12-15 17:35:32,451 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] taskDone, taskId = 20000, taskGroup = TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=1}
2023-12-15 17:35:32,451 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] Task TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=1} complete with state FAILED
2023-12-15 17:35:32,451 INFO  org.apache.seatunnel.engine.server.CoordinatorService - [localhost]:5801 [seatunnel-274994] [5.1] Received task end from execution TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=1}, state FAILED
2023-12-15 17:35:32,452 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] turn to end state FAILED.
2023-12-15 17:35:32,452 ERROR org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] end with state FAILED and Exception: java.lang.NullPointerException
        at org.apache.seatunnel.connectors.seatunnel.jdbc.internal.split.JdbcNumericBetweenParametersProvider.<init>(JdbcNumericBetweenParametersProvider.java:57)
        at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator.discoverySplits(JdbcSourceSplitEnumerator.java:118)
        at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator.run(JdbcSourceSplitEnumerator.java:87)
        at org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.stateProcess(SourceSplitEnumeratorTask.java:303)
        at org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.call(SourceSplitEnumeratorTask.java:134)
        at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:613)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:750)

2023-12-15 17:35:32,452 ERROR org.apache.seatunnel.engine.server.dag.physical.SubPlan - Task TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=1} Failed in Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], Begin to cancel other tasks in this pipeline.
2023-12-15 17:35:32,452 WARN  org.apache.seatunnel.engine.server.dag.physical.SubPlan - start cancel job Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)] count = 0
2023-12-15 17:35:32,453 INFO  org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)] turn from state RUNNING to CANCELING.
2023-12-15 17:35:32,453 INFO  org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator - start clean pending checkpoint cause Pipeline turn to end state.
2023-12-15 17:35:32,454 INFO  org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator - Turn checkpoint_state_787976049127325697_1 state from RUNNING to CANCELED
2023-12-15 17:35:32,454 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] state from CREATED to CANCELED
2023-12-15 17:35:32,454 WARN  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - The task Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] state in Imap is RUNNING, not equals expected state CREATED
2023-12-15 17:35:32,454 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] state from SCHEDULED to CANCELED
2023-12-15 17:35:32,454 WARN  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - The task Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] state in Imap is RUNNING, not equals expected state SCHEDULED
2023-12-15 17:35:32,454 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] state from DEPLOYING to CANCELED
2023-12-15 17:35:32,455 WARN  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - The task Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] state in Imap is RUNNING, not equals expected state DEPLOYING
2023-12-15 17:35:32,455 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] state from RUNNING to CANCELING
2023-12-15 17:35:32,455 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] turn from state RUNNING to CANCELING.
2023-12-15 17:35:32,456 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Send cancel Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] operator to member [localhost]:5801
2023-12-15 17:35:32,456 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] Task (TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=30000}) need cancel.
2023-12-15 17:35:32,457 WARN  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] Interrupted task 40000 - org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask@3a2a3255
2023-12-15 17:35:32,457 WARN  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] Interrupted task 50000 - org.apache.seatunnel.engine.server.task.TransformSeaTunnelTask@31c72ce2
2023-12-15 17:35:32,457 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] taskDone, taskId = 40000, taskGroup = TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=30000}
2023-12-15 17:35:32,457 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] taskDone, taskId = 50000, taskGroup = TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=30000}
2023-12-15 17:35:32,457 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-274994] [5.1] Task TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=30000} complete with state CANCELED
2023-12-15 17:35:32,457 INFO  org.apache.seatunnel.engine.server.CoordinatorService - [localhost]:5801 [seatunnel-274994] [5.1] Received task end from execution TaskGroupLocation{jobId=787976049127325697, pipelineId=1, taskGroupId=30000}, state CANCELED
2023-12-15 17:35:32,458 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] turn to end state CANCELED.
2023-12-15 17:35:32,458 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] end with state CANCELED
2023-12-15 17:35:32,458 INFO  org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)] end with state FAILED
2023-12-15 17:35:32,470 INFO  org.apache.seatunnel.connectors.seatunnel.jdbc.internal.executor.FieldNamedPreparedStatement - PrepareStatement sql is:
INSERT INTO `test`.`t_base` (`id`, `created_by`, `created_time`, `updated_by`, `updated_time`, `is_delete`, `district_code`, `name`, `sort`) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?) ON DUPLICATE KEY UPDATE `id`=VALUES(`id`), `created_by`=VALUES(`created_by`), `created_time`=VALUES(`created_time`), `updated_by`=VALUES(`updated_by`), `updated_time`=VALUES(`updated_time`), `is_delete`=VALUES(`is_delete`), `district_code`=VALUES(`district_code`), `name`=VALUES(`name`), `sort`=VALUES(`sort`)

2023-12-15 17:35:32,471 INFO  org.apache.seatunnel.connectors.seatunnel.jdbc.internal.executor.FieldNamedPreparedStatement - PrepareStatement sql is:
DELETE FROM `test`.`t_base` WHERE `id` = ?

2023-12-15 17:35:32,491 INFO  org.apache.seatunnel.engine.server.master.JobMaster - release the pipeline Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)] resource
2023-12-15 17:35:32,492 INFO  org.apache.seatunnel.engine.server.service.slot.DefaultSlotService - received slot release request, jobID: 787976049127325697, slot: SlotProfile{worker=[localhost]:5801, slotID=2, ownerJobID=787976049127325697, assigned=true, resourceProfile=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=0}}, sequence='e8de8c4b-4c33-4446-ba1a-8e1ac0a9bafb'}
2023-12-15 17:35:32,492 INFO  org.apache.seatunnel.engine.server.service.slot.DefaultSlotService - received slot release request, jobID: 787976049127325697, slot: SlotProfile{worker=[localhost]:5801, slotID=1, ownerJobID=787976049127325697, assigned=true, resourceProfile=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=0}}, sequence='e8de8c4b-4c33-4446-ba1a-8e1ac0a9bafb'}
2023-12-15 17:35:32,495 INFO  org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)] turn to end state FAILED.
2023-12-15 17:35:32,495 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalPlan - cancel job Job SeaTunnel_Job (787976049127325697) because makeJobEndWhenPipelineEnded is true
2023-12-15 17:35:32,496 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalPlan - Job SeaTunnel_Job (787976049127325697) turn from state RUNNING to CANCELLING.
2023-12-15 17:35:32,498 WARN  org.apache.seatunnel.engine.server.dag.physical.SubPlan - start cancel job Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)] count = 0
2023-12-15 17:35:32,498 WARN  org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)] is in end state FAILED, can not be cancel
2023-12-15 17:35:32,498 ERROR org.apache.seatunnel.engine.server.dag.physical.SubPlan - Pipeline is trying to leave terminal state FAILED
2023-12-15 17:35:32,498 WARN  org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job SeaTunnel_Job (787976049127325697), Pipeline: [(1/1)] cancel error
java.lang.IllegalStateException: Pipeline is trying to leave terminal state FAILED
        at org.apache.seatunnel.engine.server.dag.physical.SubPlan.updatePipelineState(SubPlan.java:348) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.dag.physical.SubPlan.cancelPipeline(SubPlan.java:414) ~[seatunnel-starter.jar:2.3.3]
        at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1640) [?:1.8.0_391]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_391]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_391]
        at java.lang.Thread.run(Thread.java:750) [?:1.8.0_391]
2023-12-15 17:35:32,499 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalPlan - Job SeaTunnel_Job (787976049127325697) turn from state CANCELLING to FAILING.
2023-12-15 17:35:32,500 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalPlan - Job SeaTunnel_Job (787976049127325697) turn from state FAILING to FAILED.
2023-12-15 17:35:32,515 INFO  org.apache.seatunnel.engine.client.job.ClientJobProxy - Job (787976049127325697) end with state FAILED
2023-12-15 17:35:32,516 INFO  com.hazelcast.core.LifecycleService - hz.client_1 [seatunnel-274994] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is SHUTTING_DOWN
2023-12-15 17:35:32,523 INFO  com.hazelcast.internal.server.tcp.TcpServerConnection - [localhost]:5801 [seatunnel-274994] [5.1] Connection[id=1, /127.0.0.1:5801->/127.0.0.1:51456, qualifier=null, endpoint=[127.0.0.1]:51456, remoteUuid=d137323d-bc3a-4c6c-924a-e484d4b5a932, alive=false, connectionType=JVM, planeIndex=-1] closed. Reason: Connection closed by the other side
2023-12-15 17:35:32,524 INFO  com.hazelcast.client.impl.connection.ClientConnectionManager - hz.client_1 [seatunnel-274994] [5.1] Removed connection to endpoint: [localhost]:5801:8b75a117-5fa7-4120-bd2a-0f65821ce8a9, connection: ClientConnection{alive=false, connectionId=1, channel=NioChannel{/127.0.0.1:51456->localhost/127.0.0.1:5801}, remoteAddress=[localhost]:5801, lastReadTime=2023-12-15 17:35:32.514, lastWriteTime=2023-12-15 17:35:31.413, closedTime=2023-12-15 17:35:32.522, connected server version=5.1}
2023-12-15 17:35:32,524 INFO  com.hazelcast.core.LifecycleService - hz.client_1 [seatunnel-274994] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is CLIENT_DISCONNECTED
2023-12-15 17:35:32,525 INFO  com.hazelcast.client.impl.ClientEndpointManager - [localhost]:5801 [seatunnel-274994] [5.1] Destroying ClientEndpoint{connection=Connection[id=1, /127.0.0.1:5801->/127.0.0.1:51456, qualifier=null, endpoint=[127.0.0.1]:51456, remoteUuid=d137323d-bc3a-4c6c-924a-e484d4b5a932, alive=false, connectionType=JVM, planeIndex=-1], clientUuid=d137323d-bc3a-4c6c-924a-e484d4b5a932, clientName=hz.client_1, authenticated=true, clientVersion=5.1, creationTime=1702632929809, latest clientAttributes=lastStatisticsCollectionTime=1702632929840,enterprise=false,clientType=JVM,clientVersion=5.1,clusterConnectionTimestamp=1702632929800,clientAddress=127.0.0.1,clientName=hz.client_1,credentials.principal=null,os.committedVirtualMemorySize=5420077056,os.freePhysicalMemorySize=338153472,os.freeSwapSpaceSize=8455180288,os.maxFileDescriptorCount=4096,os.openFileDescriptorCount=53,os.processCpuTime=6720000000,os.systemLoadAverage=0.08,os.totalPhysicalMemorySize=8201261056,os.totalSwapSpaceSize=8455712768,runtime.availableProcessors=5,runtime.freeMemory=974814856,runtime.maxMemory=1029177344,runtime.totalMemory=1029177344,runtime.uptime=3207,runtime.usedMemory=54362488, labels=[]}
2023-12-15 17:35:32,527 INFO  com.hazelcast.core.LifecycleService - hz.client_1 [seatunnel-274994] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is SHUTDOWN
2023-12-15 17:35:32,527 INFO  org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand - Closed SeaTunnel client......
2023-12-15 17:35:32,527 INFO  com.hazelcast.core.LifecycleService - [localhost]:5801 [seatunnel-274994] [5.1] [localhost]:5801 is SHUTTING_DOWN
2023-12-15 17:35:32,531 INFO  com.hazelcast.internal.partition.impl.MigrationManager - [localhost]:5801 [seatunnel-274994] [5.1] Shutdown request of Member [localhost]:5801 - 8b75a117-5fa7-4120-bd2a-0f65821ce8a9 this is handled
2023-12-15 17:35:32,535 INFO  com.hazelcast.instance.impl.Node - [localhost]:5801 [seatunnel-274994] [5.1] Shutting down connection manager...
2023-12-15 17:35:32,537 INFO  com.hazelcast.instance.impl.Node - [localhost]:5801 [seatunnel-274994] [5.1] Shutting down node engine...
2023-12-15 17:35:35,554 INFO  com.hazelcast.instance.impl.NodeExtension - [localhost]:5801 [seatunnel-274994] [5.1] Destroying node NodeExtension.
2023-12-15 17:35:35,554 INFO  com.hazelcast.instance.impl.Node - [localhost]:5801 [seatunnel-274994] [5.1] Hazelcast Shutdown is completed in 3024 ms.
2023-12-15 17:35:35,555 INFO  com.hazelcast.core.LifecycleService - [localhost]:5801 [seatunnel-274994] [5.1] [localhost]:5801 is SHUTDOWN
2023-12-15 17:35:35,555 INFO  org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand - Closed HazelcastInstance ......
2023-12-15 17:35:35,555 INFO  org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand - Closed metrics executor service ......
2023-12-15 17:35:35,555 ERROR org.apache.seatunnel.core.starter.SeaTunnel - 

===============================================================================


2023-12-15 17:35:35,555 ERROR org.apache.seatunnel.core.starter.SeaTunnel - Fatal Error, 

2023-12-15 17:35:35,555 ERROR org.apache.seatunnel.core.starter.SeaTunnel - Please submit bug report in https://github.com/apache/seatunnel/issues

2023-12-15 17:35:35,555 ERROR org.apache.seatunnel.core.starter.SeaTunnel - Reason:SeaTunnel job executed failed 

2023-12-15 17:35:35,557 ERROR org.apache.seatunnel.core.starter.SeaTunnel - Exception StackTrace:org.apache.seatunnel.core.starter.exception.CommandExecuteException: SeaTunnel job executed failed
        at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:191)
        at org.apache.seatunnel.core.starter.SeaTunnel.run(SeaTunnel.java:40)
        at org.apache.seatunnel.core.starter.seatunnel.SeaTunnelClient.main(SeaTunnelClient.java:34)
Caused by: org.apache.seatunnel.engine.common.exception.SeaTunnelEngineException: java.lang.NullPointerException
        at org.apache.seatunnel.connectors.seatunnel.jdbc.internal.split.JdbcNumericBetweenParametersProvider.<init>(JdbcNumericBetweenParametersProvider.java:57)
        at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator.discoverySplits(JdbcSourceSplitEnumerator.java:118)
        at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator.run(JdbcSourceSplitEnumerator.java:87)
        at org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.stateProcess(SourceSplitEnumeratorTask.java:303)
        at org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.call(SourceSplitEnumeratorTask.java:134)
        at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:613)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:750)

        at org.apache.seatunnel.engine.client.job.ClientJobProxy.waitForJobComplete(ClientJobProxy.java:122)
        at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:184)
        ... 2 more
 
2023-12-15 17:35:35,557 ERROR org.apache.seatunnel.core.starter.SeaTunnel - 
===============================================================================



Exception in thread "main" org.apache.seatunnel.core.starter.exception.CommandExecuteException: SeaTunnel job executed failed
        at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:191)
        at org.apache.seatunnel.core.starter.SeaTunnel.run(SeaTunnel.java:40)
        at org.apache.seatunnel.core.starter.seatunnel.SeaTunnelClient.main(SeaTunnelClient.java:34)
Caused by: org.apache.seatunnel.engine.common.exception.SeaTunnelEngineException: java.lang.NullPointerException
        at org.apache.seatunnel.connectors.seatunnel.jdbc.internal.split.JdbcNumericBetweenParametersProvider.<init>(JdbcNumericBetweenParametersProvider.java:57)
        at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator.discoverySplits(JdbcSourceSplitEnumerator.java:118)
        at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator.run(JdbcSourceSplitEnumerator.java:87)
        at org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.stateProcess(SourceSplitEnumeratorTask.java:303)
        at org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.call(SourceSplitEnumeratorTask.java:134)
        at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:613)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:750)

        at org.apache.seatunnel.engine.client.job.ClientJobProxy.waitForJobComplete(ClientJobProxy.java:122)
        at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:184)
        ... 2 more
2023-12-15 17:35:39,319 INFO  org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand - run shutdown hook because get close signal

Zeta or Flink or Spark Version

No response

Java or Scala Version

java version "1.8.0_391"

Screenshots

image

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@liugddx
Copy link
Member

liugddx commented Dec 19, 2023

if thepartition_num>1 ,you should config partition_column,``partition_upper_boundandpartition_lower_bound `

@liugddx
Copy link
Member

liugddx commented Dec 19, 2023

Copy link

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

@github-actions github-actions bot added the stale label Jan 19, 2024
Copy link

This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants