java.util.LinkedHashMap cannot be cast to java.util.ArrayList #5700

wachoo · 2023-10-25T07:44:19Z

Search before asking

I had searched in the issues and found no similar issues.

What happened

when I click this button to start running a task in seatunnel web server

exception message burst in the log :

ERROR [qtp1175146719-7472] [GlobalExceptionHandler.logError():83] - java.util.LinkedHashMap cannot be cast to java.util.ArrayList
java.lang.ClassCastException: java.util.LinkedHashMap cannot be cast to java.util.ArrayList
at org.apache.seatunnel.core.starter.utils.ConfigShadeUtils.processConfig(ConfigShadeUtils.java:143)
at org.apache.seatunnel.core.starter.utils.ConfigShadeUtils.decryptConfig(ConfigShadeUtils.java:119)
at org.apache.seatunnel.core.starter.utils.ConfigShadeUtils.decryptConfig(ConfigShadeUtils.java:104)
at org.apache.seatunnel.core.starter.utils.ConfigBuilder.ofInner(ConfigBuilder.java:53)
at org.apache.seatunnel.core.starter.utils.ConfigBuilder.lambda$of$1(ConfigBuilder.java:67)
at java.util.Optional.orElseGet(Optional.java:267)
at org.apache.seatunnel.core.starter.utils.ConfigBuilder.of(ConfigBuilder.java:67)
at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.(MultipleTableJobConfigParser.java:127)
at org.apache.seatunnel.engine.client.job.JobExecutionEnvironment.getJobConfigParser(JobExecutionEnvironment.java:63)
at org.apache.seatunnel.engine.core.job.AbstractJobEnvironment.getLogicalDag(AbstractJobEnvironment.java:109)
at org.apache.seatunnel.engine.client.job.JobExecutionEnvironment.execute(JobExecutionEnvironment.java:73)
at org.apache.seatunnel.app.service.impl.JobExecutorServiceImpl.executeJobBySeaTunnel(JobExecutorServiceImpl.java:107)
at org.apache.seatunnel.app.service.impl.JobExecutorServiceImpl.jobExecute(JobExecutorServiceImpl.java:73)
at org.apache.seatunnel.app.controller.JobExecutorController.jobExecutor(JobExecutorController.java:55)
at sun.reflect.GeneratedMethodAccessor352.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)

SeaTunnel Version

seatunnel 2.2.3
seatunnel-web 1.0.0

SeaTunnel Config

seatunnel:
  engine:
    history-job-expire-minutes: 1440
    backup-count: 1
    queue-type: blockingqueue
    print-execution-info-interval: 60
    print-job-metrics-info-interval: 60
    slot-service:
      dynamic-slot: true
    checkpoint:
      interval: 10000
      timeout: 60000
      storage:
        type: hdfs
        max-retained: 3
        plugin-config:
          namespace: /tmp/seatunnel/checkpoint_snapshot
          storage.type: hdfs
          fs.defaultFS: file:///tmp/ # Ensure that the directory has written permission

Running Command

when I click this button to start running a task in seatunnel web server

Error Exception

ERROR [qtp1175146719-7472] [GlobalExceptionHandler.logError():83] - java.util.LinkedHashMap cannot be cast to java.util.ArrayList
java.lang.ClassCastException: java.util.LinkedHashMap cannot be cast to java.util.ArrayList
	at org.apache.seatunnel.core.starter.utils.ConfigShadeUtils.processConfig(ConfigShadeUtils.java:143)
	at org.apache.seatunnel.core.starter.utils.ConfigShadeUtils.decryptConfig(ConfigShadeUtils.java:119)
	at org.apache.seatunnel.core.starter.utils.ConfigShadeUtils.decryptConfig(ConfigShadeUtils.java:104)
	at org.apache.seatunnel.core.starter.utils.ConfigBuilder.ofInner(ConfigBuilder.java:53)
	at org.apache.seatunnel.core.starter.utils.ConfigBuilder.lambda$of$1(ConfigBuilder.java:67)
	at java.util.Optional.orElseGet(Optional.java:267)
	at org.apache.seatunnel.core.starter.utils.ConfigBuilder.of(ConfigBuilder.java:67)
	at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.<init>(MultipleTableJobConfigParser.java:127)
	at org.apache.seatunnel.engine.client.job.JobExecutionEnvironment.getJobConfigParser(JobExecutionEnvironment.java:63)
	at org.apache.seatunnel.engine.core.job.AbstractJobEnvironment.getLogicalDag(AbstractJobEnvironment.java:109)
	at org.apache.seatunnel.engine.client.job.JobExecutionEnvironment.execute(JobExecutionEnvironment.java:73)
	at org.apache.seatunnel.app.service.impl.JobExecutorServiceImpl.executeJobBySeaTunnel(JobExecutorServiceImpl.java:107)
	at org.apache.seatunnel.app.service.impl.JobExecutorServiceImpl.jobExecute(JobExecutorServiceImpl.java:73)
	at org.apache.seatunnel.app.controller.JobExecutorController.jobExecutor(JobExecutorController.java:55)
	at sun.reflect.GeneratedMethodAccessor352.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)

Zeta or Flink or Spark Version

Zeta 2.3.3

Java or Scala Version

openjdk version "1.8.0_372"

Screenshots

Are you willing to submit PR?

Yes I am willing to submit a PR!

Code of Conduct

I agree to follow this project's Code of Conduct

The text was updated successfully, but these errors were encountered:

anacondapy6 · 2023-11-06T09:48:50Z

2.3.3源码执行seatunnel-examples seatunnel-engine-examples遇到了同样的问题
盼望尽快解决

RenHuifeng · 2023-11-27T09:21:26Z

**web1.0.0+seatunnel2.3.3遇到了同样问题，帮忙解决解答谢谢

guodachao · 2023-12-07T15:38:36Z

遇到了一样的问题，盼早日解决

hailin0 · 2023-12-26T07:30:38Z

2.3.3源码执行seatunnel-examples seatunnel-engine-examples遇到了同样的问题盼望尽快解决

@anacondapy6
Please add your job config to this issue

liunaijie · 2024-01-11T11:35:52Z

@guodachao @RenHuifeng @wachoo can anyone share your job config here to help debug? thanks.

guodachao · 2024-01-12T01:23:08Z

@guodachao @RenHuifeng @wachoo can anyone share your job config here to help debug? thanks.
@liunaijie

{
	"transform": {},
	"sink": {
		"Jdbc": {
			"batch_size": 1000,
			"max_retries": "3",
			"source_table_name": "Table11843972568673",
			"max_commit_attempts": 3,
			"auto_commit": "true",
			"url": "jdbc:mysql://host.docker.internal:3307/hpc?useSSL=false&useUnicode=true&characterEncoding=utf-8&allowMultiQueries=true&allowPublicKeyRetrieval=true&serverTimezone=Asia/Shanghai",
			"is_exactly_once": "false",
			"database": "hpc",
			"password": "xxx",
			"transaction_timeout_sec": -1,
			"driver": "com.mysql.cj.jdbc.Driver",
			"support_upsert_by_query_primary_key_exist": "false",
			"connection_check_timeout_sec": 30,
			"generate_sink_sql": true,
			"user": "root",
			"table": "hpc_xml_copy"
		}
	},
	"source": {
		"Jdbc": {
			"password": "xxx",
			"driver": "com.mysql.cj.jdbc.Driver",
			"parallelism": 1,
			"query": "SELECT `XML_ID`, `XML`, `XML_NAME`, `OPERATION_NAME`, `OPERATION_ID`, `OPERATION_TIME`, `GET_TYPE`, `STATUS` FROM `hpc`.`hpc_xml`",
			"connection_check_timeout_sec": 30,
			"result_table_name": "Table11843972568673",
			"fetch_size": "100",
			"user": "root",
			"url": "jdbc:mysql://host.docker.internal:3307/hpc?useSSL=false&useUnicode=true&characterEncoding=utf-8&allowMultiQueries=true&allowPublicKeyRetrieval=true&serverTimezone=Asia/Shanghai"
		}
	},
	"env": {
		"job.mode": "BATCH",
		"job.name": "SeaTunnel_Job",
		"checkpoint.interval": "10000"
	}
}

EricJoy2048 · 2024-01-18T10:00:07Z

This job config file get from seatunnel-web?

haneeshpld · 2024-01-19T11:42:58Z

@EricJoy2048
im suspecting the issue is, when the config is read from the file in working scenario it is transformed to the below format

{
    "env": {
        "job.mode": "BATCH",
        "job.name": "SeaTunnel_Job"
    },
    "source": [
        {
            "password": "xxxx",
            "driver": "com.mysql.cj.jdbc.Driver",
            "parallelism": 1,
            "query": "SELECT `id`, `name`, `owner`, `species`, `sex`, `birth`, `death` FROM `seatunnel`.`pet`",
            "connection_check_timeout_sec": 30,
            "result_table_name": "Table12261518544768",
            "plugin_name": "Jdbc",
            "user": "user",
            "url": "xxxx"
        }
    ],
    "transform": [],
    "sink": [
        {
            "batch_size": 1000,
            "max_retries": "10",
            "source_table_name": "Table12261518544768",
            "max_commit_attempts": 3,
            "auto_commit": "true",
            "plugin_name": "Jdbc",
            "url": "xxx",
            "is_exactly_once": "false",
            "database": "seasink",
            "password": "xxx",
            "transaction_timeout_sec": -1,
            "driver": "com.mysql.cj.jdbc.Driver",
            "support_upsert_by_query_primary_key_exist": "false",
            "connection_check_timeout_sec": 30,
            "generate_sink_sql": true,
            "user": "xxxx",
            "table": "pet"
        }
    ]
}

in a non working scenario it is trtransformed to below format(which is how it is stored in the file without any change in syntax)

{
    "transform": {},
    "sink": {
        "Jdbc": {
            "batch_size": 1000,
            "max_retries": "10",
            "source_table_name": "Table12307350135360",
            "max_commit_attempts": 3,
            "auto_commit": "true",
            "url": "xxx",
            "is_exactly_once": "false",
            "database": "seasink",
            "password": "xxx",
            "transaction_timeout_sec": -1,
            "driver": "com.mysql.cj.jdbc.Driver",
            "support_upsert_by_query_primary_key_exist": "false",
            "connection_check_timeout_sec": 30,
            "generate_sink_sql": true,
            "user": "xxxx",
            "table": "pet"
        }
    },
    "source": {
        "Jdbc": {
            "password": "xxx",
            "driver": "com.mysql.cj.jdbc.Driver",
            "parallelism": 1,
            "query": "SELECT `id`, `name`, `owner`, `species`, `sex`, `birth`, `death` FROM `seatunnel`.`pet`",
            "connection_check_timeout_sec": 30,
            "result_table_name": "Table12307350135360",
            "user": "xxx",
            "url": "xxx"
        }
    },
    "env": {
        "job.mode": "BATCH",
        "job.name": "SeaTunnel_Job"
    }
}

liunaijie · 2024-01-22T06:00:16Z

@EricJoy2048 @haneeshpld
Hi team, the st-web is not easy to deploy locally. I check the code, this part of code maybe cause this bug.

SeaTunnelConfigUtil.java#L36

the full stack:

I guess the st-web generated config file format is wrong.

haneeshpld · 2024-01-22T06:33:37Z

@EricJoy2048

I'm not sure if the is issue is occurring here. In my case, I have a working scenario as well as a non-working scenario.

When containerizing the application (both web and engine), it works if I run the image on the same machine where it is built. However, when I use the image on a different machine with almost identical configurations (same OS), it shows the above error.

Upon checking both the working and non-working scenarios, the above code produces the same output. Therefore, I im not sure the issue is arising from this code.

working scenario

Jdbc {
"auto_commit"="true"
"batch_size"=1000
"connection_check_timeout_sec"=30
database=seasink
driver="com.mysql.cj.jdbc.Driver"
"generate_sink_sql"=true
"is_exactly_once"="false"
"max_commit_attempts"=3
"max_retries"="10"
password=xxx
"source_table_name"=Table12348683256512
"support_upsert_by_query_primary_key_exist"="false"
table=pet
"transaction_timeout_sec"=-1
url=“xxxxx”
user=xxx
}

non workig scenario

Jdbc {
"connection_check_timeout_sec"=30
"batch_size"=1000
"is_exactly_once"="false"
"max_commit_attempts"=3
"transaction_timeout_sec"=-1
"max_retries"="10"
"auto_commit"="true"
"support_upsert_by_query_primary_key_exist"="false"
"source_table_name"=Table12340885224320
"generate_sink_sql"=true
database=seasink
table=pet
password=xxxx
driver="com.mysql.cj.jdbc.Driver"
user=xxx
url=“xxxx”
}

there is a file being written after the transformation in st-web (bin\profile\12261501203968.conf) which is in identical format in both working and non working scenario, when it is transformed again in the engine side we get the issue.

haneeshpld · 2024-01-22T06:38:49Z

Also another thing i noticed, not sure if its helpful,

there is a file ConfigParser.java, in which below part of the code im able to debugg in case of a working scenario, but not able to do the same in case of a non-working scenario, the debug points shows below error

this is the place where the transformation happens in the engine

leejoker · 2024-02-06T09:56:50Z

I resolve this problem with repackage the seatunnel-config-base module

Just change maven-shade-plugin like this:

<plugin>
                <groupId>org.apache.maven.plugins</groupId>
                <artifactId>maven-shade-plugin</artifactId>
                <configuration>
                    <minimizeJar>true</minimizeJar>
                    <createSourcesJar>true</createSourcesJar>
                    <shadeSourcesContent>true</shadeSourcesContent>
                    <shadedArtifactAttached>false</shadedArtifactAttached>
                    <createDependencyReducedPom>false</createDependencyReducedPom>
                    <filters>
                        <filter>
                            <artifact>com.typesafe:config</artifact>
                            <includes>
                                <include>**</include>
                            </includes>
                            <excludes>
                                <exclude>META-INF/MANIFEST.MF</exclude>
                                <exclude>META-INF/NOTICE</exclude>
                                <exclude>com/typesafe/config/ConfigParseOptions.class</exclude>
                                <exclude>com/typesafe/config/ConfigMergeable.class</exclude>
                                <exclude>com/typesafe/config/impl/ConfigParser.class</exclude>

                               <!-- just add this line to remove the inner class -->
                                <exclude>com/typesafe/config/impl/ConfigParser$ParseContext.class</exclude>

                                <exclude>com/typesafe/config/impl/ConfigNodePath.class</exclude>
                                <exclude>com/typesafe/config/impl/PathParser.class</exclude>
                                <exclude>com/typesafe/config/impl/Path.class</exclude>
                                <exclude>com/typesafe/config/impl/SimpleConfigObject.class</exclude>
                                <exclude>com/typesafe/config/impl/PropertiesParser.class</exclude>
                            </excludes>
                        </filter>
                    </filters>
                    <relocations>
                        <relocation>
                            <pattern>com.typesafe.config</pattern>
                            <shadedPattern>${seatunnel.shade.package}.com.typesafe.config</shadedPattern>
                        </relocation>
                    </relocations>
                    <transformers>
                        <transformer implementation="org.apache.maven.plugins.shade.resource.ApacheLicenseResourceTransformer" />
                        <transformer implementation="org.apache.maven.plugins.shade.resource.ApacheNoticeResourceTransformer" />
                    </transformers>
                </configuration>
                <executions>
                    <execution>
                        <goals>
                            <goal>shade</goal>
                        </goals>
                        <phase>package</phase>
                    </execution>
                </executions>
            </plugin>

when package the config-base module, it will relocate the package paths, but the ConfigParser$ParseContext.class is still in it.
This inner class conflicts with the same class in config-shade module.ClassLoader may not load the right one.

athiathu · 2024-02-19T08:02:49Z

Hi @leejoker I have checked with above solution but still the issue is there.

gitlifangyuan · 2024-02-27T08:54:48Z

Try it this way. Note that this is not a fundamental solution to the problem ,a temporary solution to the problem. Change the method： ConfigShadeUtils processConfig() Then install the 《seatunnel-core-starter》 module

 @SuppressWarnings("unchecked")
    private static Config processConfig(String identifier, Config config, boolean isDecrypted) {
        ConfigShade configShade = CONFIG_SHADES.getOrDefault(identifier, DEFAULT_SHADE);
        List<String> sensitiveOptions = new ArrayList<>(Arrays.asList(DEFAULT_SENSITIVE_OPTIONS));
        sensitiveOptions.addAll(Arrays.asList(configShade.sensitiveOptions()));
        BiFunction<String, Object, String> processFunction =
                (key, value) -> {
                    if (isDecrypted) {
                        return configShade.decrypt(value.toString());
                    } else {
                        return configShade.encrypt(value.toString());
                    }
                };
        String jsonString = config.root().render(ConfigRenderOptions.concise());
        ObjectNode jsonNodes = JsonUtils.parseObject(jsonString);
        Map<String, Object> configMap = JsonUtils.toMap(jsonNodes);
        List<Map<String, Object>> sources = new ArrayList<>();
        try {
            sources = (ArrayList<Map<String, Object>>) configMap.get(Constants.SOURCE);
        } catch (ClassCastException e) {
            log.info("ClassCastException : " + e.getMessage() );
            Map<String, Object> tmp = (Map<String, Object>) configMap.get(Constants.SOURCE);
            for (String key : tmp.keySet()) {
                Map<String, Object> tmp1  = (Map<String, Object>) tmp.get(key);
                tmp1.put("plugin_name",key);
                sources.add(tmp1);
            }

        }
        List<Map<String, Object>> sinks = new ArrayList<>();
        try {
            sinks = (ArrayList<Map<String, Object>>) configMap.get(Constants.SINK);
        } catch (ClassCastException e) {
            log.info("ClassCastException : " + e.getMessage() );
            Map<String, Object> tmp = (Map<String, Object>)configMap.get(Constants.SINK);
            for (String key : tmp.keySet()) {
                Map<String, Object> tmp1  = (Map<String, Object>) tmp.get(key);
                tmp1.put("plugin_name",key);
                sinks.add(tmp1);
            }
        }
        List<Map<String, Object>> transform = new ArrayList<>();
        try {
            transform = (ArrayList<Map<String, Object>>) configMap.get(Constants.TRANSFORM);
        } catch (ClassCastException e) {
            log.info("ClassCastException : " + e.getMessage() );
            Map<String, Object> tmp = (Map<String, Object>)configMap.get(Constants.TRANSFORM);
            for (String key : tmp.keySet()) {
                Map<String, Object> tmp1  = (Map<String, Object>) tmp.get(key);
                tmp1.put("plugin_name",key);
                transform.add(tmp1);
            }
        }
        Preconditions.checkArgument(
                !sources.isEmpty(), "Miss <Source> config! Please check the config file.");
        Preconditions.checkArgument(
                !sinks.isEmpty(), "Miss <Sink> config! Please check the config file.");
        sources.forEach(
                source -> {
                    for (String sensitiveOption : sensitiveOptions) {
                        source.computeIfPresent(sensitiveOption, processFunction);
                    }
                });
        sinks.forEach(
                sink -> {
                    for (String sensitiveOption : sensitiveOptions) {
                        sink.computeIfPresent(sensitiveOption, processFunction);
                    }
                });
        configMap.put(Constants.SOURCE, sources);
        configMap.put(Constants.TRANSFORM, transform);
        configMap.put(Constants.SINK, sinks);
        return ConfigFactory.parseMap(configMap);
    }

18308996929 · 2024-03-27T07:37:52Z

所以这个问题最后最好的解决方法是？？？？

Etoakor · 2024-06-20T06:16:44Z

所以，一年了还没解决？

shenzhy5 · 2024-06-29T04:54:42Z

@leejoker Thanks！you are right！

shenzhy5 · 2024-06-29T04:58:52Z

@athiathu try install the seatunnel to your local repository and then package the seatunnel-web.

anhdbbt · 2024-07-09T12:18:27Z

@EricJoy2048 @haneeshpld Hi team, the st-web is not easy to deploy locally. I check the code, this part of code maybe cause this bug.

SeaTunnelConfigUtil.java#L36

the full stack:

1. https://github.com/apache/seatunnel-web/blob/1.0.0-release/seatunnel-server/seatunnel-app/src/main/java/org/apache/seatunnel/app/service/impl/JobExecutorServiceImpl.java#L66

2. https://github.com/apache/seatunnel-web/blob/1.0.0-release/seatunnel-server/seatunnel-app/src/main/java/org/apache/seatunnel/app/service/impl/JobInstanceServiceImpl.java#L137

3. https://github.com/apache/seatunnel-web/blob/1.0.0-release/seatunnel-server/seatunnel-app/src/main/java/org/apache/seatunnel/app/service/impl/JobInstanceServiceImpl.java#L166

4. https://github.com/apache/seatunnel-web/blob/1.0.0-release/seatunnel-server/seatunnel-app/src/main/java/org/apache/seatunnel/app/utils/SeaTunnelConfigUtil.java#L36

I guess the st-web generated config file format is wrong.

agree with your guess，but if i change these template , another problem occured which is caused by the template too.
so ,i modify the code below，and it works! but ... Obviously，its not meticulously designed.

org.apache.seatunnel.core.starter.utils.ConfigShadeUtils.java

wachoo added the bug label Oct 25, 2023

KangTomwk mentioned this issue Dec 26, 2023

[OnlineMeeting&Dec.14] SeaTunnel community meeting Topic collection #6053

Closed

liunaijie mentioned this issue Feb 27, 2024

[Improve] add log to debug task instance submitted config apache/seatunnel-web#155

Open

3 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

java.util.LinkedHashMap cannot be cast to java.util.ArrayList #5700

java.util.LinkedHashMap cannot be cast to java.util.ArrayList #5700

wachoo commented Oct 25, 2023

anacondapy6 commented Nov 6, 2023

RenHuifeng commented Nov 27, 2023

guodachao commented Dec 7, 2023

hailin0 commented Dec 26, 2023 •

edited

Loading

liunaijie commented Jan 11, 2024

guodachao commented Jan 12, 2024 •

edited

Loading

EricJoy2048 commented Jan 18, 2024

haneeshpld commented Jan 19, 2024 •

edited

Loading

liunaijie commented Jan 22, 2024

haneeshpld commented Jan 22, 2024

haneeshpld commented Jan 22, 2024 •

edited

Loading

leejoker commented Feb 6, 2024

athiathu commented Feb 19, 2024

gitlifangyuan commented Feb 27, 2024 •

edited

Loading

18308996929 commented Mar 27, 2024

Etoakor commented Jun 20, 2024

shenzhy5 commented Jun 29, 2024

shenzhy5 commented Jun 29, 2024

anhdbbt commented Jul 9, 2024

java.util.LinkedHashMap cannot be cast to java.util.ArrayList #5700

java.util.LinkedHashMap cannot be cast to java.util.ArrayList #5700

Comments

wachoo commented Oct 25, 2023

Search before asking

What happened

SeaTunnel Version

SeaTunnel Config

Running Command

Error Exception

Zeta or Flink or Spark Version

Java or Scala Version

Screenshots

Are you willing to submit PR?

Code of Conduct

anacondapy6 commented Nov 6, 2023

RenHuifeng commented Nov 27, 2023

guodachao commented Dec 7, 2023

hailin0 commented Dec 26, 2023 • edited Loading

liunaijie commented Jan 11, 2024

guodachao commented Jan 12, 2024 • edited Loading

EricJoy2048 commented Jan 18, 2024

haneeshpld commented Jan 19, 2024 • edited Loading

liunaijie commented Jan 22, 2024

haneeshpld commented Jan 22, 2024

haneeshpld commented Jan 22, 2024 • edited Loading

leejoker commented Feb 6, 2024

athiathu commented Feb 19, 2024

gitlifangyuan commented Feb 27, 2024 • edited Loading

18308996929 commented Mar 27, 2024

Etoakor commented Jun 20, 2024

shenzhy5 commented Jun 29, 2024

shenzhy5 commented Jun 29, 2024

anhdbbt commented Jul 9, 2024

hailin0 commented Dec 26, 2023 •

edited

Loading

guodachao commented Jan 12, 2024 •

edited

Loading

haneeshpld commented Jan 19, 2024 •

edited

Loading

haneeshpld commented Jan 22, 2024 •

edited

Loading

gitlifangyuan commented Feb 27, 2024 •

edited

Loading