Skip to content

[INLONG-9402][Sort] Solve errors in UT test logs for sort-end-to-end-tests, but UT results show as successful#9940

Merged
dockerzhang merged 3 commits into
apache:masterfrom
XiaoYou201:INLONG-9402
Apr 10, 2024
Merged

[INLONG-9402][Sort] Solve errors in UT test logs for sort-end-to-end-tests, but UT results show as successful#9940
dockerzhang merged 3 commits into
apache:masterfrom
XiaoYou201:INLONG-9402

Conversation

@XiaoYou201
Copy link
Copy Markdown
Contributor

Prepare a Pull Request

Motivation

As issue #9402 description, there were two case encountered error but the final result show as successful.

Modifications

  • Case1

Question: Warning: Illegal reflective access by org.apache.flink.api.java.ClosureCleaner (file:/opt/flink/lib/flink-dist-1.15.4.jar) to field java.lang.String.value.

Reason: This error message indicates an illegal reflective access operation occurring while using Apache Flink, which is an open-source framework for processing streaming and batch data. Specifically, the error occurs because org.apache.flink.api.java.ClosureCleaner attempts to access the value field of the java.lang.String class illegally. This is more common with higher versions of Java, starting from Java 9 onwards, as the JDK has imposed stricter access controls on internal APIs to enhance security and modularity.

Solve: Change the flink docker java version from 11(flink:1.15.4-scala_2.12) to 8(flink:1.15.4-scala_2.12-java8).

  • Case2

Question: Can't connect the mysql server and through errors in logs, the results show as successful.

Reason:The issue which run end-to-end-tests use ci_ut.yaml, so it will lead to some network problem. Because ahead module test maybe change the newort adapter.

Solve: Now, the project add ci_ut_flink13.yaml and ci_ut_flink15.yaml. The 1.13 and 1.15 end-to-end test can be tested without other module influence.The detail of yaml file as PR #9924 and #9869 .

@aloyszhang aloyszhang added this to the 1.12.0 milestone Apr 9, 2024
@XiaoYou201
Copy link
Copy Markdown
Contributor Author

In end-to-end-test-v1.15, because the postgreSQL module use debezuim.postgreSQL v1.6 package which base on java 11 or high. And this package use reflect, So, the postgreSQL module still has

Warning: Illegal reflective access by org.apache.flink.api.java.ClosureCleaner (file:/opt/flink/lib/flink-dist-1.15.4.jar) to field java.lang.String.value.

As https://debezium.io/releases/1.6/
image

@dockerzhang dockerzhang merged commit 25f7baf into apache:master Apr 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Improve][Sort] Errors in UT test logs for sort-end-to-end-tests, but UT results show as successful

4 participants