Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug] [MySQL-CDC] Encounter NoSuchMethodError: org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceReader.isNoMoreSplitsAssignment() #7455

Closed
2 of 3 tasks
gphwxhq opened this issue Aug 22, 2024 · 2 comments
Closed
2 of 3 tasks

[Bug] [MySQL-CDC] Encounter NoSuchMethodError: org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceReader.isNoMoreSplitsAssignment() #7455

gphwxhq opened this issue Aug 22, 2024 · 2 comments
Labels
bug stale

Comments

@gphwxhq
Copy link

gphwxhq commented Aug 22, 2024 •
edited
Loading

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

When I was synchronizing data for MYSQL5.7.40-log version using the 2.3.7 version of mysql-cdc component and I encountered a java.lang.NosuchMethodError: org.apache.setannel.connectors.cdc.base.source.reader.IncrementalSourceReader.isNoMoreSplitsAssigning() error, the same script runs normally in version 2.3.5

SeaTunnel Version

2.3.7

SeaTunnel Config

{
  "env": {
    "job.mode": "STREAMING",
    "job.name": "SeaTunnel_Job"
  },

  "source": [
    {
      "snapshot.split.size": 8096,
      "snapshot.fetch.size": 1024,
      "incremental.parallelism": 1,
      "connect.timeout.ms": 30000,
      "connect.max-retries": 3,
      "connection.pool.size": 20,
      "chunk-key.even-distribution.factor.lower-bound": 0.05,
      "chunk-key.even-distribution.factor.upper-bound": 100,
      "sample-sharding.threshold": 1000,
      "inverse-sampling.rate": 1000,
      "startup.mode": "INITIAL",
      "exactly_once": "false",
      "stop.mode": "NEVER",
      "parallelism": 1,
      "result_table_name": "Table3942752403328",
      "catalog": {
        "factory": "Mysql"
      },
      "database-names": ["cdc_test"],
      "table-names": ["cdc_test.source"],
      "format": "DEFAULT",
      "base-url": "jdbc:mysql://localhost:33062/cdc_test?useUnicode=true&allowPublicKeyRetrieval=true&serverTimezone=Asia/Shanghai&useLegacyDatetimeCode=false&nullNamePatternMatchesAll=true&characterEncoding=UTF-8&useSSL=false&",
      "password": "",
      "username": "",
      "plugin_name": "MySQL-CDC"
    }
  ],
  "transform": [],
  "sink": [
    {
      "schema_save_mode": "CREATE_SCHEMA_WHEN_NOT_EXIST",
      "data_save_mode": "APPEND_DATA",
      "create_index": "true",
      "connection_check_timeout_sec": 30,
      "batch_size": 1000,
      "is_exactly_once": "false",
      "max_commit_attempts": 3,
      "transaction_timeout_sec": -1,
      "max_retries": 0,
      "auto_commit": "true",
      "support_upsert_by_query_primary_key_exist": "false",
      "multi_table_sink_replica": 1,
      "source_table_name": "Table3942752403328",
      "generate_sink_sql": true,
      "database": "cdc_test",
      "table": "sink",
      "password": "",
      "driver": "com.mysql.cj.jdbc.Driver",
      "user": "root",
      "url": "jdbc:mysql://localhost:33062/cdc_test?useUnicode=true&allowPublicKeyRetrieval=true&serverTimezone=Asia/Shanghai&useLegacyDatetimeCode=false&nullNamePatternMatchesAll=true&characterEncoding=UTF-8&useSSL=false&",
      "plugin_name": "Jdbc"
    }
  ]
}

Running Command

using submit api

Error Exception

2024-08-22 14:49:37,777 INFO [.p.t.AuthenticationMessageTask] [hz.main.priority-generic-operation.thread-0] - [localhost]:5801 [seatunnel] [5.1] Received auth from Connection[id=4, /10.233.69.52:5801->/10.233.72.7:45441, qualifier=null, endpoint=[10.233.72.7]:45441, remoteUuid=e2c574c0-0de7-4297-aca4-b21bf1d47e01, alive=true, connectionType=JVM, planeIndex=-1], successfully authenticated, clientUuid: e2c574c0-0de7-4297-aca4-b21bf1d47e01, client name: hz.client_1, client version: 5.1

2024-08-22 14:49:51,035 INFO [o.a.s.c.s.u.ConfigBuilder ] [hz.main.cached.thread-4] - Loading config file from objectMap

2024-08-22 14:49:51,087 INFO [o.a.s.c.s.u.ConfigShadeUtils ] [hz.main.cached.thread-4] - Load config shade spi: [base64]

2024-08-22 14:49:51,119 INFO [p.MultipleTableJobConfigParser] [hz.main.cached.thread-4] - add common jar in plugins :[]

2024-08-22 14:49:51,130 INFO [.s.p.d.AbstractPluginDiscovery] [hz.main.cached.thread-4] - Load SeaTunnelSink Plugin from /opt/software/apache-seatunnel-2.3.7/connectors

2024-08-22 14:49:51,137 INFO [.s.p.d.AbstractPluginDiscovery] [hz.main.cached.thread-4] - Discovery plugin jar for: PluginIdentifier{engineType='seatunnel', pluginType='source', pluginName='MySQL-CDC'} at: file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-cdc-mysql-2.3.7.jar

2024-08-22 14:49:51,137 INFO [.s.p.d.AbstractPluginDiscovery] [hz.main.cached.thread-4] - Discovery plugin jar for: PluginIdentifier{engineType='seatunnel', pluginType='sink', pluginName='Jdbc'} at: file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-jdbc-2.3.7.jar

2024-08-22 14:49:51,138 INFO [.c.c.DefaultClassLoaderService] [hz.main.cached.thread-4] - Create classloader for job 878893716679426049 with jars [file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-cdc-mysql-2.3.7.jar, file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-jdbc-2.3.7.jar]

2024-08-22 14:49:51,141 WARN [o.a.s.a.c.u.ConfigUtil ] [hz.main.cached.thread-4] - Option 'source_table_name' is a List, and it is recommended to configure it as ["string1","string2"]; we will only use ',' to split the String into a list.

2024-08-22 14:49:51,142 INFO [p.MultipleTableJobConfigParser] [hz.main.cached.thread-4] - start generating all sources.

2024-08-22 14:49:51,655 INFO [.s.c.s.j.c.AbstractJdbcCatalog] [hz.main.cached.thread-4] - Catalog MySQL established connection to jdbc:mysql://10.0.1.71:33062/cdc_test?useUnicode=true&allowPublicKeyRetrieval=true&serverTimezone=Asia/Shanghai&useLegacyDatetimeCode=false&nullNamePatternMatchesAll=true&characterEncoding=UTF-8&useSSL=false&

2024-08-22 14:49:51,682 INFO [o.a.s.a.t.c.CatalogTableUtil ] [hz.main.cached.thread-4] - Get catalog tables, cost time: 27 ms

2024-08-22 14:49:51,686 INFO [.s.c.s.j.c.AbstractJdbcCatalog] [hz.main.cached.thread-4] - Catalog MySQL closing

2024-08-22 14:49:51,756 INFO [o.a.s.a.t.f.FactoryUtil ] [hz.main.cached.thread-4] - get the CatalogTable from source MySQL-CDC: MySQL.cdc_test.source

2024-08-22 14:49:51,767 INFO [.s.p.d.AbstractPluginDiscovery] [hz.main.cached.thread-4] - Load SeaTunnelSource Plugin from /opt/software/apache-seatunnel-2.3.7/connectors

2024-08-22 14:49:51,790 INFO [.s.p.d.AbstractPluginDiscovery] [hz.main.cached.thread-4] - Discovery plugin jar for: PluginIdentifier{engineType='seatunnel', pluginType='source', pluginName='MySQL-CDC'} at: file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-cdc-mysql-2.3.7.jar

2024-08-22 14:49:51,792 INFO [p.MultipleTableJobConfigParser] [hz.main.cached.thread-4] - start generating all transforms.

2024-08-22 14:49:51,792 INFO [p.MultipleTableJobConfigParser] [hz.main.cached.thread-4] - start generating all sinks.

2024-08-22 14:49:51,792 WARN [o.a.s.a.c.u.ConfigUtil ] [hz.main.cached.thread-4] - Option 'source_table_name' is a List, and it is recommended to configure it as ["string1","string2"]; we will only use ',' to split the String into a list.

2024-08-22 14:49:51,796 INFO [.s.p.d.AbstractPluginDiscovery] [hz.main.cached.thread-4] - Load SeaTunnelSink Plugin from /opt/software/apache-seatunnel-2.3.7/connectors

2024-08-22 14:49:51,797 INFO [.s.p.d.AbstractPluginDiscovery] [hz.main.cached.thread-4] - Discovery plugin jar for: PluginIdentifier{engineType='seatunnel', pluginType='sink', pluginName='Jdbc'} at: file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-jdbc-2.3.7.jar

2024-08-22 14:49:51,809 INFO [o.a.s.a.t.f.FactoryUtil ] [hz.main.cached.thread-4] - Create sink 'Jdbc' with upstream input catalog-table[database: cdc_test, schema: null, table: source]

2024-08-22 14:49:51,843 INFO [.c.c.DefaultClassLoaderService] [hz.main.cached.thread-4] - Release classloader for job 878893716679426049 with jars [file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-cdc-mysql-2.3.7.jar, file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-jdbc-2.3.7.jar]

2024-08-22 14:49:51,964 INFO [o.a.s.e.s.m.JobMaster ] [seatunnel-coordinator-service-1] - Init JobMaster for Job SeaTunnel_Job (878893716679426049)

2024-08-22 14:49:51,964 INFO [o.a.s.e.s.m.JobMaster ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049) needed jar urls [file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-cdc-mysql-2.3.7.jar, file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-jdbc-2.3.7.jar]

2024-08-22 14:49:51,964 INFO [.c.c.DefaultClassLoaderService] [seatunnel-coordinator-service-1] - Create classloader for job 878893716679426049 with jars [file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-cdc-mysql-2.3.7.jar, file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-jdbc-2.3.7.jar]

2024-08-22 14:49:52,093 INFO [.s.c.s.j.c.AbstractJdbcCatalog] [seatunnel-coordinator-service-1] - Catalog MySQL established connection to jdbc:mysql://10.0.1.71:33062/cdc_test?useUnicode=true&allowPublicKeyRetrieval=true&serverTimezone=Asia/Shanghai&useLegacyDatetimeCode=false&nullNamePatternMatchesAll=true&characterEncoding=UTF-8&useSSL=false&

2024-08-22 14:49:52,106 INFO [a.s.a.s.SaveModeExecuteWrapper] [seatunnel-coordinator-service-1] - Executing save mode for table: cdc_test.sink, with SchemaSaveMode: CREATE_SCHEMA_WHEN_NOT_EXIST, DataSaveMode: APPEND_DATA using Catalog: MySQL

2024-08-22 14:49:52,108 INFO [.s.c.s.j.c.AbstractJdbcCatalog] [seatunnel-coordinator-service-1] - Catalog MySQL closing

2024-08-22 14:49:52,176 INFO [.c.c.DefaultClassLoaderService] [seatunnel-coordinator-service-1] - Release classloader for job 878893716679426049 with jars [file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-cdc-mysql-2.3.7.jar, file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-jdbc-2.3.7.jar]

2024-08-22 14:49:52,646 WARN [o.a.h.u.NativeCodeLoader ] [seatunnel-coordinator-service-1] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

2024-08-22 14:49:52,968 INFO [.s.e.s.c.CheckpointCoordinator] [seatunnel-coordinator-service-1] - Create CheckpointCoordinator for job(1@878893716679426049) with plan(CheckpointPlan(pipelineId=1, pipelineSubtasks=[TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}, taskID=20000, index=0}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}, taskID=40000, index=0}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}, taskID=50000, index=0}], startingSubtasks=[TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}, taskID=20000, index=0}], pipelineActions={ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC])=1, ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-Jdbc-MultiTableSink])=1}, subtaskActions={TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}, taskID=20000, index=0}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), -1)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}, taskID=40000, index=0}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), 0)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}, taskID=50000, index=0}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-Jdbc-MultiTableSink]), 0)]}))

2024-08-22 14:49:52,970 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-1] - The task Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SourceTask (1/1)] is in state CREATED when init state future

2024-08-22 14:49:52,971 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-1] - The task Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SplitEnumerator (1/1)] is in state CREATED when init state future

2024-08-22 14:49:52,974 INFO [o.a.s.e.s.d.p.PhysicalPlan ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049) state process is start

2024-08-22 14:49:52,976 INFO [o.a.s.e.s.d.p.PhysicalPlan ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049) turned from state CREATED to SCHEDULED.

2024-08-22 14:49:52,976 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)] state process is start

2024-08-22 14:49:52,978 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)] turned from state CREATED to SCHEDULED.

2024-08-22 14:49:52,995 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)] turned from state SCHEDULED to DEPLOYING.

2024-08-22 14:49:52,996 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SplitEnumerator (1/1)] state process is start

2024-08-22 14:49:52,999 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SplitEnumerator (1/1)] turned from state CREATED to DEPLOYING.

2024-08-22 14:49:53,013 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-1] - [localhost]:5801 [seatunnel] [5.1] received deploying task executionId [878893716679491585]

2024-08-22 14:49:53,019 INFO [.c.c.DefaultClassLoaderService] [seatunnel-coordinator-service-1] - Create classloader for job 878893716679426049 with jars [file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-cdc-mysql-2.3.7.jar]

2024-08-22 14:49:53,063 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-1] - [localhost]:5801 [seatunnel] [5.1] deploying task TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}, executionId [878893716679491585]

2024-08-22 14:49:53,063 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-1] - [localhost]:5801 [seatunnel] [5.1] deploying TaskGroup TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1} init success

2024-08-22 14:49:53,068 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-1] - [localhost]:5801 [seatunnel] [5.1] deploying TaskGroup TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1} success

2024-08-22 14:49:53,070 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SplitEnumerator (1/1)] turned from state DEPLOYING to RUNNING.

2024-08-22 14:49:53,071 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SplitEnumerator (1/1)] current state equals target state: RUNNING, skip

2024-08-22 14:49:53,071 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SourceTask (1/1)] state process is start

2024-08-22 14:49:53,072 INFO [.s.t.SourceSplitEnumeratorTask] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - starting seatunnel source split enumerator task, source name: pipeline-1 [Source[0]-MySQL-CDC]

2024-08-22 14:49:53,074 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SourceTask (1/1)] turned from state CREATED to DEPLOYING.

2024-08-22 14:49:53,105 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-1] - [localhost]:5801 [seatunnel] [5.1] received deploying task executionId [878893716679557121]

2024-08-22 14:49:53,105 INFO [.c.c.DefaultClassLoaderService] [seatunnel-coordinator-service-1] - Create classloader for job 878893716679426049 with jars [file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-cdc-mysql-2.3.7.jar, file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-jdbc-2.3.7.jar]

2024-08-22 14:49:53,139 INFO [.p.t.AuthenticationMessageTask] [hz.main.priority-generic-operation.thread-0] - [localhost]:5801 [seatunnel] [5.1] Received auth from Connection[id=6, /10.233.69.52:5801->/10.233.72.7:37373, qualifier=null, endpoint=[10.233.72.7]:37373, remoteUuid=912b2a52-e85e-4eaa-89c6-838317821982, alive=true, connectionType=JVM, planeIndex=-1], successfully authenticated, clientUuid: 912b2a52-e85e-4eaa-89c6-838317821982, client name: hz.client_2, client version: 5.1

2024-08-22 14:49:53,155 WARN [i.d.c.m.MySqlConnection ] [hz.main.seaTunnel.task.thread-2] - Database configuration option 'serverTimezone' is set but is obsolete, please use 'connectionTimeZone' instead

2024-08-22 14:49:53,160 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-1] - [localhost]:5801 [seatunnel] [5.1] deploying task TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}, executionId [878893716679557121]

2024-08-22 14:49:53,161 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-1] - [localhost]:5801 [seatunnel] [5.1] deploying TaskGroup TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000} init success

2024-08-22 14:49:53,162 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-1] - [localhost]:5801 [seatunnel] [5.1] deploying TaskGroup TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000} success

2024-08-22 14:49:53,164 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SourceTask (1/1)] turned from state DEPLOYING to RUNNING.

2024-08-22 14:49:53,164 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SourceTask (1/1)] current state equals target state: RUNNING, skip

2024-08-22 14:49:53,165 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)] turned from state DEPLOYING to RUNNING.

2024-08-22 14:49:53,166 INFO [o.a.s.e.s.d.p.PhysicalPlan ] [seatunnel-coordinator-service-1] - Job SeaTunnel_Job (878893716679426049) turned from state SCHEDULED to RUNNING.

2024-08-22 14:49:53,182 INFO [s.e.s.t.TransformSeaTunnelTask] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - starting seatunnel transform task, index 0

2024-08-22 14:49:53,203 INFO [.c.s.c.m.u.TableDiscoveryUtils] [hz.main.seaTunnel.task.thread-2] - Read list of available databases

2024-08-22 14:49:53,220 INFO [a.s.a.s.m.MultiTableSinkWriter] [hz.main.seaTunnel.task.thread-5] - init multi table sink writer, queue size: 1

2024-08-22 14:49:53,333 INFO [.c.s.c.m.u.TableDiscoveryUtils] [hz.main.seaTunnel.task.thread-2] - list of available databases is: [cdc_test]

2024-08-22 14:49:53,333 INFO [.c.s.c.m.u.TableDiscoveryUtils] [hz.main.seaTunnel.task.thread-2] - Read list of available tables in each database

2024-08-22 14:49:53,352 INFO [i.d.j.JdbcConnection ] [pool-8-thread-1] - Connection gracefully closed

2024-08-22 14:49:53,355 WARN [i.d.c.m.MySqlConnection ] [hz.main.seaTunnel.task.thread-2] - Database configuration option 'serverTimezone' is set but is obsolete, please use 'connectionTimeZone' instead

2024-08-22 14:49:53,386 INFO [i.d.j.JdbcConnection ] [pool-9-thread-1] - Connection gracefully closed

2024-08-22 14:49:53,392 INFO [.c.b.s.e.SnapshotSplitAssigner] [hz.main.seaTunnel.task.thread-2] - SnapshotSplitAssigner created with remaining tables: [cdc_test.source]

2024-08-22 14:49:53,394 INFO [.c.b.s.e.SnapshotSplitAssigner] [hz.main.seaTunnel.task.thread-2] - SnapshotSplitAssigner created with remaining splits: []

2024-08-22 14:49:53,394 INFO [.c.b.s.e.SnapshotSplitAssigner] [hz.main.seaTunnel.task.thread-2] - SnapshotSplitAssigner created with assigned splits: []

2024-08-22 14:49:53,398 INFO [.a.s.e.s.t.SourceSeaTunnelTask] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - starting seatunnel source task, index 0

2024-08-22 14:49:53,510 INFO [a.s.c.s.c.s.r.SourceReaderBase] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - Open Source Reader.

2024-08-22 14:49:53,517 INFO [.s.t.SourceSplitEnumeratorTask] [hz.main.seaTunnel.task.thread-2] - received reader register, readerID: TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}, taskID=40000, index=0}

2024-08-22 14:49:53,529 INFO [.s.e.s.c.CheckpointCoordinator] [seatunnel-coordinator-service-3] - checkpoint is enabled, start schedule trigger pending checkpoint.

2024-08-22 14:49:53,620 INFO [.s.t.SourceSplitEnumeratorTask] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - received enough reader, starting enumerator...

2024-08-22 14:49:53,622 WARN [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - [localhost]:5801 [seatunnel] [5.1] Exception in org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask@6442dd4e

java.lang.NoSuchMethodError: org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceReader.isNoMoreSplitsAssignment()Z

at org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceReader.pollNext(IncrementalSourceReader.java:115) ~[?:?]

at org.apache.seatunnel.engine.server.task.flow.SourceFlowLifeCycle.collect(SourceFlowLifeCycle.java:156) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask.collect(SourceSeaTunnelTask.java:127) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.task.SeaTunnelTask.stateProcess(SeaTunnelTask.java:168) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask.call(SourceSeaTunnelTask.java:132) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:717) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.TaskExecutionService$NamedTaskWrapper.run(TaskExecutionService.java:1039) ~[seatunnel-starter.jar:2.3.7]

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_333]

at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_333]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_333]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_333]

at java.lang.Thread.run(Thread.java:750) [?:1.8.0_333]

2024-08-22 14:49:53,622 WARN [i.d.c.m.MySqlConnection ] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - Database configuration option 'serverTimezone' is set but is obsolete, please use 'connectionTimeZone' instead

2024-08-22 14:49:53,622 INFO [bstractJdbcSourceChunkSplitter] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - Start splitting table cdc_test.source into chunks...

2024-08-22 14:49:53,622 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - [localhost]:5801 [seatunnel] [5.1] taskDone, taskId = 40000, taskGroup = TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}

2024-08-22 14:49:53,622 WARN [bstractJdbcSourceChunkSplitter] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - No primary key found for table cdc_test.source

2024-08-22 14:49:53,622 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - [localhost]:5801 [seatunnel] [5.1] task 40000 error with exception: [java.lang.NoSuchMethodError: org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceReader.isNoMoreSplitsAssignment()Z], cancel other task in taskGroup TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}.

2024-08-22 14:49:53,623 WARN [bstractJdbcSourceChunkSplitter] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - No unique key found for table cdc_test.source

2024-08-22 14:49:53,623 WARN [bstractJdbcSourceChunkSplitter] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - No evenly split column found for table cdc_test.source

2024-08-22 14:49:53,623 WARN [bstractJdbcSourceChunkSplitter] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - No evenly split column found for table cdc_test.source, use single split org.apache.seatunnel.connectors.cdc.base.source.split.SnapshotSplit@9caef52f

2024-08-22 14:49:53,623 INFO [bstractJdbcSourceChunkSplitter] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - Split table cdc_test.source into 1 chunks, time cost: 1ms.

2024-08-22 14:49:53,624 WARN [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - [localhost]:5801 [seatunnel] [5.1] Interrupted task 50000 - org.apache.seatunnel.engine.server.task.TransformSeaTunnelTask@2d446b60

2024-08-22 14:49:53,624 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - [localhost]:5801 [seatunnel] [5.1] taskDone, taskId = 50000, taskGroup = TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}

2024-08-22 14:49:53,624 INFO [.c.c.DefaultClassLoaderService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - Release classloader for job 878893716679426049 with jars [file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-cdc-mysql-2.3.7.jar, file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-jdbc-2.3.7.jar]

2024-08-22 14:49:53,631 INFO [a.s.c.s.c.s.r.SourceReaderBase] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - Closing Source Reader.

2024-08-22 14:49:53,631 INFO [.c.c.DefaultClassLoaderService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - recycle classloader for thread BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}

2024-08-22 14:49:53,631 INFO [.c.c.DefaultClassLoaderService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - recycle classloader for thread BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}

2024-08-22 14:49:53,650 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - [localhost]:5801 [seatunnel] [5.1] taskGroup TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000} complete with FAILED

2024-08-22 14:49:53,651 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - [localhost]:5801 [seatunnel] [5.1] task 50000 error with exception: [java.lang.NoSuchMethodError: org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceReader.isNoMoreSplitsAssignment()Z], cancel other task in taskGroup TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}.

2024-08-22 14:49:53,653 INFO [o.a.s.e.s.TaskExecutionService] [hz.main.seaTunnel.task.thread-4] - [localhost]:5801 [seatunnel] [5.1] Task TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000} complete with state FAILED

2024-08-22 14:49:53,655 INFO [o.a.s.e.s.CoordinatorService ] [hz.main.seaTunnel.task.thread-4] - [localhost]:5801 [seatunnel] [5.1] Received task end from execution TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}, state FAILED

2024-08-22 14:49:53,663 WARN [o.a.s.s.c.z.h.HikariConfig ] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - HikariPool-1 - idleTimeout has been set but has no effect because the pool is operating as a fixed size pool.

2024-08-22 14:49:53,663 INFO [o.a.s.s.c.z.h.HikariDataSource] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - HikariPool-1 - Starting...

2024-08-22 14:49:53,666 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [hz.main.seaTunnel.task.thread-4] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SourceTask (1/1)] turned from state RUNNING to FAILED.

2024-08-22 14:49:53,666 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [hz.main.seaTunnel.task.thread-4] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SourceTask (1/1)] state process is stopped

2024-08-22 14:49:53,666 ERROR [o.a.s.e.s.d.p.PhysicalVertex ] [hz.main.seaTunnel.task.thread-4] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SourceTask (1/1)] end with state FAILED and Exception: java.lang.NoSuchMethodError: org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceReader.isNoMoreSplitsAssignment()Z

at org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceReader.pollNext(IncrementalSourceReader.java:115)

at org.apache.seatunnel.engine.server.task.flow.SourceFlowLifeCycle.collect(SourceFlowLifeCycle.java:156)

at org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask.collect(SourceSeaTunnelTask.java:127)

at org.apache.seatunnel.engine.server.task.SeaTunnelTask.stateProcess(SeaTunnelTask.java:168)

at org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask.call(SourceSeaTunnelTask.java:132)

at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:717)

at org.apache.seatunnel.engine.server.TaskExecutionService$NamedTaskWrapper.run(TaskExecutionService.java:1039)

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

at java.util.concurrent.FutureTask.run(FutureTask.java:266)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

at java.lang.Thread.run(Thread.java:750)

2024-08-22 14:49:53,666 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-3] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SourceTask (1/1)] future complete with state FAILED

2024-08-22 14:49:53,666 ERROR [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-3] - Task TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000} Failed in Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], Begin to cancel other tasks in this pipeline.

2024-08-22 14:49:53,668 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-3] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)] turned from state RUNNING to FAILING.

2024-08-22 14:49:53,669 INFO [o.a.s.e.s.m.JobMaster ] [hz.main.seaTunnel.task.thread-4] - release the task group resource TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}

2024-08-22 14:49:53,669 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-3] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SplitEnumerator (1/1)] state process is start

2024-08-22 14:49:53,670 INFO [a.s.e.s.s.s.DefaultSlotService] [hz.main.generic-operation.thread-41] - received slot release request, jobID: 878893716679426049, slot: SlotProfile{worker=[localhost]:5801, slotID=2, ownerJobID=878893716679426049, assigned=true, resourceProfile=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=0}}, sequence='b7ecbb90-a077-42c8-8594-cdb83dd7d2bb'}

2024-08-22 14:49:53,670 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-3] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SplitEnumerator (1/1)] turned from state RUNNING to CANCELING.

2024-08-22 14:49:53,676 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-3] - Send cancel Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SplitEnumerator (1/1)] operator to member [localhost]:5801

2024-08-22 14:49:53,676 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-3] - [localhost]:5801 [seatunnel] [5.1] Task (TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}) need cancel.

2024-08-22 14:49:53,677 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-3] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SourceTask (1/1)] state process is start

2024-08-22 14:49:53,700 INFO [o.a.s.s.c.z.h.HikariDataSource] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - HikariPool-1 - Start completed.

2024-08-22 14:49:53,717 INFO [.e.FieldNamedPreparedStatement] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - PrepareStatement sql is:

INSERT INTO `cdc_test`.`sink` (`id`, `name`, `address`, `tesi`) VALUES (?, ?, ?, ?)

2024-08-22 14:49:53,737 INFO [.JdbcMultiTableResourceManager] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - start close connection poolHikariPool-1

2024-08-22 14:49:53,737 INFO [o.a.s.s.c.z.h.HikariDataSource] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - HikariPool-1 - Shutdown initiated...

2024-08-22 14:49:53,741 INFO [o.a.s.s.c.z.h.HikariDataSource] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000}] - HikariPool-1 - Shutdown completed.

2024-08-22 14:49:55,637 ERROR [e.s.t.o.s.AssignSplitOperation] [hz.main.generic-operation.thread-40] - [localhost]:5801 [seatunnel] [5.1] task group TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000} not found.

org.apache.seatunnel.engine.server.exception.TaskGroupContextNotFoundException: task group TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000} not found.

at org.apache.seatunnel.engine.server.TaskExecutionService.getActiveExecutionContext(TaskExecutionService.java:247) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.TaskExecutionService.getTask(TaskExecutionService.java:313) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.task.operation.source.AssignSplitOperation.lambda$run$0(AssignSplitOperation.java:57) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.common.utils.RetryUtils.retryWithException(RetryUtils.java:48) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.task.operation.source.AssignSplitOperation.run(AssignSplitOperation.java:54) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationservice.Operation.call(Operation.java:189) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.call(OperationRunnerImpl.java:273) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.run(OperationRunnerImpl.java:248) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.run(OperationRunnerImpl.java:213) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.process(OperationThread.java:175) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.process(OperationThread.java:139) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.executeRun(OperationThread.java:123) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.internal.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:102) ~[seatunnel-starter.jar:2.3.7]

2024-08-22 14:49:55,641 WARN [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - [localhost]:5801 [seatunnel] [5.1] Exception in org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask@7cd5c766

java.util.concurrent.CompletionException: org.apache.seatunnel.engine.server.exception.TaskGroupContextNotFoundException: task group TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000} not found.

at com.hazelcast.spi.impl.AbstractInvocationFuture.returnOrThrowWithJoinConventions(AbstractInvocationFuture.java:819) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.AbstractInvocationFuture.resolveAndThrowWithJoinConvention(AbstractInvocationFuture.java:835) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.AbstractInvocationFuture.join(AbstractInvocationFuture.java:553) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.task.context.SeaTunnelSplitEnumeratorContext.assignSplit(SeaTunnelSplitEnumeratorContext.java:86) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.api.source.SourceSplitEnumerator$Context.assignSplit(SourceSplitEnumerator.java:102) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.connectors.cdc.base.source.enumerator.IncrementalSourceEnumerator.assignSplits(IncrementalSourceEnumerator.java:176) ~[?:?]

at org.apache.seatunnel.connectors.cdc.base.source.enumerator.IncrementalSourceEnumerator.run(IncrementalSourceEnumerator.java:70) ~[?:?]

at org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.stateProcess(SourceSplitEnumeratorTask.java:319) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.call(SourceSplitEnumeratorTask.java:138) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:717) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.TaskExecutionService$NamedTaskWrapper.run(TaskExecutionService.java:1039) ~[seatunnel-starter.jar:2.3.7]

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_333]

at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_333]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_333]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_333]

at java.lang.Thread.run(Thread.java:750) [?:1.8.0_333]

Caused by: org.apache.seatunnel.engine.server.exception.TaskGroupContextNotFoundException: task group TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=30000} not found.

at org.apache.seatunnel.engine.server.TaskExecutionService.getActiveExecutionContext(TaskExecutionService.java:247) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.TaskExecutionService.getTask(TaskExecutionService.java:313) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.task.operation.source.AssignSplitOperation.lambda$run$0(AssignSplitOperation.java:57) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.common.utils.RetryUtils.retryWithException(RetryUtils.java:48) ~[seatunnel-starter.jar:2.3.7]

at org.apache.seatunnel.engine.server.task.operation.source.AssignSplitOperation.run(AssignSplitOperation.java:54) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationservice.Operation.call(Operation.java:189) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.call(OperationRunnerImpl.java:273) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.run(OperationRunnerImpl.java:248) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.run(OperationRunnerImpl.java:213) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.process(OperationThread.java:175) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.process(OperationThread.java:139) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.executeRun(OperationThread.java:123) ~[seatunnel-starter.jar:2.3.7]

at com.hazelcast.internal.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:102) ~[seatunnel-starter.jar:2.3.7]

2024-08-22 14:49:55,641 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - [localhost]:5801 [seatunnel] [5.1] taskDone, taskId = 20000, taskGroup = TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}

2024-08-22 14:49:55,641 INFO [.c.c.DefaultClassLoaderService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - Release classloader for job 878893716679426049 with jars [file:/opt/software/apache-seatunnel-2.3.7/connectors/connector-cdc-mysql-2.3.7.jar]

2024-08-22 14:49:55,645 INFO [.c.c.DefaultClassLoaderService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - recycle classloader for thread BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}

2024-08-22 14:49:55,649 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - [localhost]:5801 [seatunnel] [5.1] taskGroup TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1} complete with CANCELED

2024-08-22 14:49:55,650 INFO [.e.IncrementalSourceEnumerator] [BlockingWorker-TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}] - Closing enumerator...

2024-08-22 14:49:55,650 INFO [o.a.s.e.s.TaskExecutionService] [hz.main.seaTunnel.task.thread-3] - [localhost]:5801 [seatunnel] [5.1] Task TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1} complete with state CANCELED

2024-08-22 14:49:55,650 INFO [o.a.s.e.s.CoordinatorService ] [hz.main.seaTunnel.task.thread-3] - [localhost]:5801 [seatunnel] [5.1] Received task end from execution TaskGroupLocation{jobId=878893716679426049, pipelineId=1, taskGroupId=1}, state CANCELED

2024-08-22 14:49:55,652 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [hz.main.seaTunnel.task.thread-3] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SplitEnumerator (1/1)] turned from state CANCELING to CANCELED.

2024-08-22 14:49:55,652 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [hz.main.seaTunnel.task.thread-3] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SplitEnumerator (1/1)] state process is stopped

2024-08-22 14:49:55,652 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-3] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SplitEnumerator (1/1)] future complete with state CANCELED

2024-08-22 14:49:55,654 INFO [.s.e.s.c.CheckpointCoordinator] [seatunnel-coordinator-service-3] - start clean pending checkpoint cause Pipeline turn to end state.

2024-08-22 14:49:55,657 INFO [.s.e.s.c.CheckpointCoordinator] [seatunnel-coordinator-service-3] - Turn checkpoint_state_878893716679426049_1 state from null to CANCELED

2024-08-22 14:49:55,658 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-3] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)] will end with state FAILED

2024-08-22 14:49:55,660 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-3] - Job SeaTunnel_Job (878893716679426049), Pipeline: [(1/1)] turned from state FAILING to FAILED.

Zeta or Flink or Spark Version

Zeta 2.3.7

Java or Scala Version

No response

Screenshots

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct
@gphwxhq gphwxhq added the bug label Aug 22, 2024
@github-actions GitHub Actions
Copy link

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

@github-actions github-actions bot added the stale label Sep 22, 2024
@github-actions GitHub Actions
Copy link

This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug stale
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@gphwxhq