[Improve][IT]Solve the path problem when IT runs under windows

[tmljob]

Purpose of this pull request

Solve the path problem when IT runs under windows

Check list

• Code changed are covered with tests, or it does not need tests for reason:
• If any new Jar binary package adding in your PR, please add License Notice according
  New License Guide
• If necessary, please update the documentation to describe the new feature. https://github.com/apache/incubator-seatunnel/tree/dev/docs

[ruanwenjun]

I remember we find the testcontainer has problem on Windows, so in fact we will not run IT in Windows now, do you think if we need to support IT on Windows? @wuchunfu.

[tmljob]

I remember we find the testcontainer has problem on Windows, so in fact we will not run IT in Windows now, do you think if we need to support IT on Windows? @wuchunfu.

I develop in the windows environment, and after developing the plug-in, I want to verify it through IT, so I think it is still meaningful for IT to run under windows, and there are problems that can be solved.

[tmljob]

In the Windows environment, the log indicates that the related connector jar package cannot be loaded, and the log is detailed in the attachment, but the current IT use case can be executed, which is rather strange. At 2022-05-12 01:33:58, "Wenjun Ruan" ***@***.***> wrote: In fact, we have CI on Windows, it can run successfully~. Are you sure this change is needed? — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: ***@***.***> 22/05/12 09:12:44 ERROR SparkContainer: 22/05/12 01:12:39 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties 22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-clickhouse-2.1.1-SNAPSHOT.jar does not exist, skipping. 22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-console-2.1.1-SNAPSHOT.jar does not exist, skipping. 22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-doris-2.1.1-SNAPSHOT.jar does not exist, skipping. 22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-elasticsearch-2.1.1-SNAPSHOT.jar does not exist, skipping. 22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-email-2.1.1-SNAPSHOT.jar does not exist, skipping. 22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-fake-2.1.1-SNAPSHOT.jar does not exist, skipping. 22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-feishu-2.1.1-SNAPSHOT.jar does not exist, skipping. 22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-file-2.1.1-SNAPSHOT.jar does not exist, skipping. 22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hbase-2.1.1-SNAPSHOT.jar does not exist, skipping. 22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hive-2.1.1-SNAPSHOT.jar does not exist, skipping. 22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-http-2.1.1-SNAPSHOT.jar does not exist, skipping. 22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hudi-2.1.1-SNAPSHOT.jar does not exist, skipping. 22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-iceberg-2.1.1-SNAPSHOT.jar does not exist, skipping. 22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-jdbc-2.1.1-SNAPSHOT.jar does not exist, skipping. 22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-kafka-2.1.1-SNAPSHOT.jar does not exist, skipping. 22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-kudu-2.1.1-SNAPSHOT.jar does not exist, skipping. 22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-mongodb-2.1.1-SNAPSHOT.jar does not exist, skipping. 22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-neo4j-2.1.1-SNAPSHOT.jar does not exist, skipping. 22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-phoenix-2.1.1-SNAPSHOT.jar does not exist, skipping. 22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-redis-2.1.1-SNAPSHOT.jar does not exist, skipping. 22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-socket-2.1.1-SNAPSHOT.jar does not exist, skipping. 22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-tidb-2.1.1-SNAPSHOT.jar does not exist, skipping. 22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-webhook-2.1.1-SNAPSHOT.jar does not exist, skipping. 22/05/12 01:12:40 INFO ConfigBuilder: Loading config file: /tmp/fake/fakesource_to_console.conf 22/05/12 01:12:40 INFO ConfigBuilder: parsed config file: { "env" : { "spark.app.name" : "SeaTunnel", "spark.executor.instances" : 2, "spark.executor.cores" : 1, "spark.executor.memory" : "1g", "spark.master" : "local" }, "source" : [ { "result_table_name" : "my_dataset", "plugin_name" : "Fake" } ], "transform" : [], "sink" : [ { "plugin_name" : "Console" } ] } 22/05/12 01:12:40 INFO SparkContext: Running Spark version 2.4.3 22/05/12 01:12:40 INFO SparkContext: Submitted application: SeaTunnel 22/05/12 01:12:40 INFO SecurityManager: Changing view acls to: spark 22/05/12 01:12:40 INFO SecurityManager: Changing modify acls to: spark 22/05/12 01:12:40 INFO SecurityManager: Changing view acls groups to: 22/05/12 01:12:40 INFO SecurityManager: Changing modify acls groups to: 22/05/12 01:12:40 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(spark); groups with view permissions: Set(); users with modify permissions: Set(spark); groups with modify permissions: Set() 22/05/12 01:12:40 INFO Utils: Successfully started service 'sparkDriver' on port 43881. 22/05/12 01:12:40 INFO SparkEnv: Registering MapOutputTracker 22/05/12 01:12:40 INFO SparkEnv: Registering BlockManagerMaster 22/05/12 01:12:40 INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information 22/05/12 01:12:40 INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up 22/05/12 01:12:40 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-4fb85862-c852-4dce-ab47-2e0360340937 22/05/12 01:12:40 INFO MemoryStore: MemoryStore started with capacity 366.3 MB 22/05/12 01:12:40 INFO SparkEnv: Registering OutputCommitCoordinator 22/05/12 01:12:40 INFO Utils: Successfully started service 'SparkUI' on port 4040. 22/05/12 01:12:40 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://4d50326a6034:4040 22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-clickhouse-2.1.1-SNAPSHOT.jar to Spark environment java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-clickhouse-2.1.1-SNAPSHOT.jar not found at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838) at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.SparkContext.<init>(SparkContext.scala:458) at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43) at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61) at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49) at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52) at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39) at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849) at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-console-2.1.1-SNAPSHOT.jar to Spark environment java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-console-2.1.1-SNAPSHOT.jar not found at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838) at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.SparkContext.<init>(SparkContext.scala:458) at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43) at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61) at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49) at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52) at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39) at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849) at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-doris-2.1.1-SNAPSHOT.jar to Spark environment java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-doris-2.1.1-SNAPSHOT.jar not found at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838) at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.SparkContext.<init>(SparkContext.scala:458) at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43) at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61) at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49) at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52) at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39) at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849) at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-elasticsearch-2.1.1-SNAPSHOT.jar to Spark environment java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-elasticsearch-2.1.1-SNAPSHOT.jar not found at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838) at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.SparkContext.<init>(SparkContext.scala:458) at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43) at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61) at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49) at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52) at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39) at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849) at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-email-2.1.1-SNAPSHOT.jar to Spark environment java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-email-2.1.1-SNAPSHOT.jar not found at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838) at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.SparkContext.<init>(SparkContext.scala:458) at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43) at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61) at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49) at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52) at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39) at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849) at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-fake-2.1.1-SNAPSHOT.jar to Spark environment java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-fake-2.1.1-SNAPSHOT.jar not found at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838) at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.SparkContext.<init>(SparkContext.scala:458) at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43) at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61) at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49) at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52) at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39) at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849) at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-feishu-2.1.1-SNAPSHOT.jar to Spark environment java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-feishu-2.1.1-SNAPSHOT.jar not found at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838) at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.SparkContext.<init>(SparkContext.scala:458) at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43) at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61) at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49) at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52) at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39) at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849) at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-file-2.1.1-SNAPSHOT.jar to Spark environment java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-file-2.1.1-SNAPSHOT.jar not found at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838) at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.SparkContext.<init>(SparkContext.scala:458) at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43) at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61) at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49) at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52) at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39) at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849) at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hbase-2.1.1-SNAPSHOT.jar to Spark environment java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hbase-2.1.1-SNAPSHOT.jar not found at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838) at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.SparkContext.<init>(SparkContext.scala:458) at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43) at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61) at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49) at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52) at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39) at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849) at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hive-2.1.1-SNAPSHOT.jar to Spark environment java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hive-2.1.1-SNAPSHOT.jar not found at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838) at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.SparkContext.<init>(SparkContext.scala:458) at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43) at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61) at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49) at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52) at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39) at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849) at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-http-2.1.1-SNAPSHOT.jar to Spark environment java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-http-2.1.1-SNAPSHOT.jar not found at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838) at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.SparkContext.<init>(SparkContext.scala:458) at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43) at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61) at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49) at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52) at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39) at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849) at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hudi-2.1.1-SNAPSHOT.jar to Spark environment java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hudi-2.1.1-SNAPSHOT.jar not found at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838) at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.SparkContext.<init>(SparkContext.scala:458) at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43) at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61) at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49) at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52) at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39) at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849) at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-iceberg-2.1.1-SNAPSHOT.jar to Spark environment java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-iceberg-2.1.1-SNAPSHOT.jar not found at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838) at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.SparkContext.<init>(SparkContext.scala:458) at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43) at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61) at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49) at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52) at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39) at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849) at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-jdbc-2.1.1-SNAPSHOT.jar to Spark environment java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-jdbc-2.1.1-SNAPSHOT.jar not found at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838) at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.SparkContext.<init>(SparkContext.scala:458) at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43) at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61) at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49) at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52) at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39) at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849) at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-kafka-2.1.1-SNAPSHOT.jar to Spark environment java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-kafka-2.1.1-SNAPSHOT.jar not found at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838) at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.SparkContext.<init>(SparkContext.scala:458) at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43) at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61) at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49) at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52) at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39) at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849) at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-kudu-2.1.1-SNAPSHOT.jar to Spark environment java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-kudu-2.1.1-SNAPSHOT.jar not found at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838) at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.SparkContext.<init>(SparkContext.scala:458) at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43) at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61) at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49) at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52) at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39) at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849) at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-mongodb-2.1.1-SNAPSHOT.jar to Spark environment java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-mongodb-2.1.1-SNAPSHOT.jar not found at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838) at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.SparkContext.<init>(SparkContext.scala:458) at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43) at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61) at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49) at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52) at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39) at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849) at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-neo4j-2.1.1-SNAPSHOT.jar to Spark environment java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-neo4j-2.1.1-SNAPSHOT.jar not found at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838) at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.SparkContext.<init>(SparkContext.scala:458) at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43) at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61) at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49) at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52) at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39) at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849) at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-phoenix-2.1.1-SNAPSHOT.jar to Spark environment java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-phoenix-2.1.1-SNAPSHOT.jar not found at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838) at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.SparkContext.<init>(SparkContext.scala:458) at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43) at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61) at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49) at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52) at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39) at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849) at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-redis-2.1.1-SNAPSHOT.jar to Spark environment java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-redis-2.1.1-SNAPSHOT.jar not found at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838) at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.SparkContext.<init>(SparkContext.scala:458) at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43) at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61) at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49) at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52) at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39) at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849) at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-socket-2.1.1-SNAPSHOT.jar to Spark environment java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-socket-2.1.1-SNAPSHOT.jar not found at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838) at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.SparkContext.<init>(SparkContext.scala:458) at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43) at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61) at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49) at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52) at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39) at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849) at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-tidb-2.1.1-SNAPSHOT.jar to Spark environment java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-tidb-2.1.1-SNAPSHOT.jar not found at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838) at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.SparkContext.<init>(SparkContext.scala:458) at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935) at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106) at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43) at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61) at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49) at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52) at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39) at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849) at org.apache.spark.deploy.SparkSu

[ruanwenjun]

I remember we find the testcontainer has problem on Windows, so in fact we will not run IT in Windows now, do you think if we need to support IT on Windows? @wuchunfu.

I develop in the windows environment, and after developing the plug-in, I want to verify it through IT, so I think it is still meaningful for IT to run under windows, and there are problems that can be solved.

It would be great, if we can run IT on Windows, my concern is that can we able to solve this kind of problems, and maintain two environment will cost a lot of attention. But it would be better if you want to maintain this module.

[wuchunfu]

I remember we find the testcontainer has problem on Windows, so in fact we will not run IT in Windows now, do you think if we need to support IT on Windows? @wuchunfu.

I develop in the windows environment, and after developing the plug-in, I want to verify it through IT, so I think it is still meaningful for IT to run under windows, and there are problems that can be solved.

It would be great, if we can run IT on Windows, my concern is that can we able to solve this kind of problems, and maintain two environment will cost a lot of attention. But it would be better if you want to maintain this module.

testcontainers doesn't seem to be supported in windows , so I'll remove this integration test first in ci , please refer to testcontainers/testcontainers-java#2960 and https://stackoverflow.com/questions/66077884/testcontainers-in-windows-environment-on-github-actions-could-not-find-a-valid , If you can fix that, that's the best.