Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Permanent excludes: Non applicable tests for openj9 #1297

Closed
M-Davies opened this issue Aug 22, 2019 · 24 comments
Closed

Permanent excludes: Non applicable tests for openj9 #1297

M-Davies opened this issue Aug 22, 2019 · 24 comments
Labels
bug
Projects
aqa-tests
Milestone
August 2019

Comments

@M-Davies
Copy link
Contributor

M-Davies commented Aug 22, 2019 •
edited
Loading

These openjdk tests have been permanently excluded since they are currently unsuitable for OpenJ9 as they refer to Hotspot specific internals or implementations (please add to this list using the same format shown below).

Format:

  • [testname] \n [link to test] as per [link to issue] \n

JDK8

JDK11

JDK13

JDK14
This was referenced Aug 22, 2019
Closed
Merged
@karianna karianna added this to the August 2019 milestone Aug 24, 2019
@karianna karianna added this to TODO in aqa-tests via automation Aug 24, 2019
@karianna karianna added the bug label Aug 24, 2019
aqa-tests automation moved this from TODO to Done Aug 24, 2019
@smlambert smlambert changed the title Non applicable tests for openjdk11-openj9 implementation Permanent excludes: Non applicable tests for openjdk11-openj9 implementation Sep 4, 2019
@M-Davies M-Davies changed the title Permanent excludes: Non applicable tests for openjdk11-openj9 implementation Permanent excludes: Non applicable tests for openj9 Sep 19, 2019
smlambert pushed a commit that referenced this issue Sep 19, 2019
@M-Davies
Updated links to issues (#1343)
70dfb37 
* Un-excluded java/lang/String/UnicodeCasingTest.java from problem list

* Updated issue links

Unicode casing test deleted as [#4688](eclipse-openj9/openj9#4688) fixes the issue

* Updated weblinks

* Updated issue links

* Issue links updated

* Updated problem list weblinks

* Updated issue links

* Ricochet.java passes

java/lang/invoke/RicochetTest.java is now passing on nightly build's`11.0.5+6-201909111831` and upwards
```
openjdk version "11.0.5" 2019-10-15
OpenJDK Runtime Environment AdoptOpenJDK (build 11.0.5+6-201909111831)
Eclipse OpenJ9 VM AdoptOpenJDK (build master-d65742671, JRE 11 Linux amd64-64-Bit Compressed References 20190911_331 (JIT enabled, AOT enabled)
OpenJ9   - d65742671
OMR      - 7e9584ea
JCL      - 8057a0754d based on jdk-11.0.5+6)
```

* CustomizedLambdaForm has been fixed as per issue eclipse-openj9/openj9#7080

* perm excludes point to #1297
@smlambert smlambert mentioned this issue Sep 19, 2019
Merged
smlambert pushed a commit that referenced this issue Sep 23, 2019
@M-Davies
Updating JDK11-openj9 and JDK13-openj9 Problem Lists (#1364)
7be07a5 
* Un-excluded java/lang/String/UnicodeCasingTest.java from problem list
* Updated issue links

Unicode casing test deleted as [#4688](eclipse-openj9/openj9#4688) fixes the issue

* Ricochet.java passes

java/lang/invoke/RicochetTest.java is now passing on nightly build's`11.0.5+6-201909111831` and upwards
```
* CustomizedLambdaForm has been fixed as per issue eclipse-openj9/openj9#7080

* perm excludes point to #1297

* Perm exclude SpecialInterfaceCall

* JDK11 Prob list links

* AutomaticModulesTest is now passing

* Reinclude currently failing tests

* Reincluded failing tests, PR#1359 already does this
@adam-thorpe
Copy link
Contributor

Can i suggest a change to this to help with readability; using the format:
java/lang/String/test1.java [link to issue]

As it is quite hard to see which tests are in this list

@M-Davies
Copy link
Contributor Author

Done 👍

@M-Davies
Copy link
Contributor Author

I noticed that the links to the files were all pointing to JDK11 files and not their own implementations. This has been fixed

@adam-thorpe
Copy link
Contributor

java/lang/Class/GetModuleTest.java on jdk11 and 13: eclipse-openj9/openj9#3040

@adam-thorpe
Copy link
Contributor

java/util/concurrent/atomic/VMSupportsCS8.java on jdk8 and 11: #1347

@adam-thorpe
Copy link
Contributor

java/lang/ClassLoader/LibraryPathProperty.java on jdk11+ eclipse-openj9/openj9#8440

This was referenced Feb 22, 2020
Closed
Closed
@adam-thorpe
Copy link
Contributor

java/util/logging/TestLoggerWeakRefLeak.java (all versions) #1352

@smlambert smlambert mentioned this issue Dec 3, 2020
Merged
@smlambert
Copy link
Contributor

Permanently excluding, java/util/WeakHashMap/GCDuringIteration.java (for jdk11+, eclipse-openj9/openj9#10256) via #2083

@smlambert
Copy link
Contributor

java/lang/StringBuilder/HugeCapacity.java (for jdk16, eclipse-openj9/openj9#10582) via #2141

@smlambert smlambert mentioned this issue Jan 11, 2021
Merged
@andrew-m-leonard
Copy link
Contributor

Adding for jdk8 only:

com/sun/crypto/provider/Cipher/AES/TestAESCiphers/TestAESWithProviderChange.java
com/sun/crypto/provider/Cipher/AES/TestAESCiphers/TestAESWithRemoveAddProvider.java

Highlighted originally by issue: eclipse-openj9/openj9#11614

@smlambert smlambert mentioned this issue Mar 3, 2021
Merged
@psoujany
Copy link
Contributor

psoujany commented Mar 5, 2021

Excluding java/lang/management/MemoryMXBean/ResetPeakMemoryUsage on openj9 as this test is specific to hotspot.
Excluding the above on jdk11+.

@andrew-m-leonard
Copy link
Contributor

@psoujany
Copy link
Contributor

psoujany commented Mar 29, 2021 •
edited
Loading

Excluding below tests as per #2422
java/lang/management/ManagementFactory/ValidateOpenTypes.java
java/lang/management/MemoryMXBean/MemoryManagement.java
java/lang/management/ManagementFactory/ProxyTypeMapping.java
java/lang/management/MemoryMXBean/CollectionUsageThreshold.java
java/lang/management/MemoryMXBean/LowMemoryTest2.sh
java/lang/management/GarbageCollectorMXBean/GcInfoCompositeType.java
java/lang/management/CompositeData/MemoryUsageCompositeData.java
javax/management/remote/mandatory/connection/DefaultAgentFilterTest.java
sun/management/jmxremote/bootstrap/LocalManagementTest.java
sun/management/jmxremote/startstop/JMXStartStopTest.java
sun/management/jmxremote/startstop/JMXStatusPerfCountersTest.java
sun/management/jmxremote/startstop/JMXStatusTest.java

babsingh added a commit to babsingh/aqa-tests that referenced this issue Mar 1, 2023
@babsingh
Permanently disable ContinuationTest
f04d989 
Refer to adoptium#1297 to permanently exclude.

Related: eclipse-openj9/openj9#16792
Related: adoptium#1297

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>
@babsingh babsingh mentioned this issue Mar 1, 2023
Merged
smlambert pushed a commit that referenced this issue Mar 1, 2023
@babsingh
Permanently disable ContinuationTest (#4382)
15920f9 
Refer to #1297 to permanently exclude.

Related: eclipse-openj9/openj9#16792
Related: #1297

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>
sophia-guo pushed a commit to sophia-guo/openjdk-tests that referenced this issue Mar 10, 2023
@babsingh @sophia-guo
Permanently disable ContinuationTest (adoptium#4382)
942c7f0 
Refer to adoptium#1297 to permanently exclude.

Related: eclipse-openj9/openj9#16792
Related: adoptium#1297

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>
sophia-guo pushed a commit to sophia-guo/openjdk-tests that referenced this issue Mar 10, 2023
@babsingh @sophia-guo
Permanently disable ContinuationTest (adoptium#4382)
4d05053 
Refer to adoptium#1297 to permanently exclude.

Related: eclipse-openj9/openj9#16792
Related: adoptium#1297

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>
smlambert added a commit that referenced this issue Mar 10, 2023
@sophia-guo @ChengJin01
@Mesbah-Alam @pshipton @babsingh @fengxue-IS @JasonFengJ9 @github-actions @smlambert
(V0.9.6 release) Cherry pick for V0.9.6 release-jdk20 (#4414)
29f4069 
* Set up jdk for jck interactive (#4239)

* Set up jdk for jck interactive

Signed-off-by: Sophia Guo <sophia.gwf@gmail.com>

* Add parameter SETUP_JCK_RUN explicitely

Signed-off-by: Sophia Guo <sophia.gwf@gmail.com>

---------

Signed-off-by: Sophia Guo <sophia.gwf@gmail.com>

* [Jtreg/FFI] Disable FFI related test suite in JDK20 (#4318)

The change is to exclude the FFI related test cases
in AttachTest.java captured at
eclipse-openj9/openj9#16656
given the FFI related code in JDK20 has been disabled
for the moment and will be enabled once the code has
been updated against the latest APIs.

Signed-off-by: ChengJin01 <jincheng@ca.ibm.com>

* Fix if condition for tck interactive setup (#4320)

Signed-off-by: Mesbah Alam <Mesbah_Alam@ca.ibm.com>

* [Jtreg/FFI] update the issue no for FFI test suites in JDK20 (#4324)

The change updates the issue no by replacing
#16656 with #16565 as #16656 will be closed
as duplicate of #16565, in which case #16565
serves as the only issue that keeps track of
the excluded FFI test suites in JDK20.

Signed-off-by: ChengJin01 <jincheng@ca.ibm.com>

* Add OpenJ9 timeout handler to security and rmi extended tests (#4333)

Signed-off-by: Peter Shipton <Peter_Shipton@ca.ibm.com>

* Disable GetStackTraceSuspendedStressTest (#4360)

Related: eclipse-openj9/openj9#16751

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>

* Update JDK20 exclude list (#4371)

Re-enable Thread related tests fixed in JDK19

Signed-off-by: Jack Lu <Jack.S.Lu@ibm.com>

* Disable ContinuationTest (#4380)

ContinuationTest is being disabled for OpenJ9 since it is specific to
the reference implementation and it does not apply to OpenJ9.

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>

* Permanently disable ContinuationTest (#4382)

Refer to #1297 to permanently exclude.

Related: eclipse-openj9/openj9#16792
Related: #1297

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>

* Exclude jdk/internal/platform/docker/TestDockerCpuMetrics.java (#4387)

Signed-off-by: Jason Feng <fengj@ca.ibm.com>

* AUTO: auto exclude test jdk_svc_sanity plat=ppc64_aix impl=hotspot (#4389)

- related: #4218 (comment)

Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: smlambert <smlambert@users.noreply.github.com>

---------

Signed-off-by: Sophia Guo <sophia.gwf@gmail.com>
Signed-off-by: ChengJin01 <jincheng@ca.ibm.com>
Signed-off-by: Mesbah Alam <Mesbah_Alam@ca.ibm.com>
Signed-off-by: Peter Shipton <Peter_Shipton@ca.ibm.com>
Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>
Signed-off-by: Jack Lu <Jack.S.Lu@ibm.com>
Signed-off-by: Jason Feng <fengj@ca.ibm.com>
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: Cheng Jin <jincheng@ca.ibm.com>
Co-authored-by: Mesbah Alam <Mesbah_Alam@ca.ibm.com>
Co-authored-by: Peter Shipton <Peter_Shipton@ca.ibm.com>
Co-authored-by: Babneet Singh <babsingh@users.noreply.github.com>
Co-authored-by: Jack Lu <Jack.S.Lu@ibm.com>
Co-authored-by: Jason Feng <fengj@ca.ibm.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: smlambert <smlambert@users.noreply.github.com>
@llxia llxia mentioned this issue Mar 21, 2023
Merged
@psoujany
Copy link
Contributor

Excluding below test as per runtimes/backlog/issues/795
sun/security/ssl/CipherSuite/DisabledCurve.java

@llxia llxia mentioned this issue Apr 3, 2023
Merged
@ChengJin01
Copy link
Contributor

Excluding below test on OpenJ9 for JDK20 as per #4489 given VaList was removed in https://openjdk.org/jeps/442:
java/foreign/valist/VaListTest.java

@psoujany
Copy link
Contributor

Excluding below test as per #4535
sun/security/pkcs12/KeytoolOpensslInteropTest.java

@psoujany psoujany mentioned this issue Apr 26, 2023
Open
@llxia llxia mentioned this issue Apr 26, 2023
Merged
babsingh added a commit to babsingh/aqa-tests that referenced this issue May 2, 2023
@babsingh
Update JDK20 Test Exclude List
1e62b01 
- NotSuspended/GetStackTraceNotSuspendedStressTest has been fixed.
- SuspendThread/suspendthrd03 has been removed in JDK20.
- Now, VThreadTest fails because of eclipse-openj9/openj9#15920.
- eclipse-openj9/openj9#16185 and eclipse-openj9/openj9#16279 are
permanently excluded. Changed their reason to adoptium#1297 to support
the test tool, which automatically enables tests after the related
issues are closed.

Related:
- eclipse-openj9/openj9#16688
- eclipse-openj9/openj9#16242
- eclipse-openj9/openj9#17307

Depends on eclipse-openj9/openj9#17318

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>
@babsingh babsingh mentioned this issue May 2, 2023
Merged
llxia added a commit that referenced this issue May 2, 2023
@babsingh @karianna @llxia
Update JDK20 Test Exclude List (#4554)
a931b92 
- NotSuspended/GetStackTraceNotSuspendedStressTest has been fixed.
- SuspendThread/suspendthrd03 has been removed in JDK20.
- Now, VThreadTest fails because of eclipse-openj9/openj9#15920.
- eclipse-openj9/openj9#16185 and eclipse-openj9/openj9#16279 are
permanently excluded. Changed their reason to #1297 to support
the test tool, which automatically enables tests after the related
issues are closed.

Related:
- eclipse-openj9/openj9#16688
- eclipse-openj9/openj9#16242
- eclipse-openj9/openj9#17307

Depends on eclipse-openj9/openj9#17318

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>
Co-authored-by: Martijn Verburg <martijnverburg@gmail.com>
Co-authored-by: Lan Xia <19273206+llxia@users.noreply.github.com>
@psoujany
Copy link
Contributor

psoujany commented May 8, 2023

Excluding below tests on z/OS for JDK17
java/foreign/StdLibTest.java
java/foreign/TestCircularInit1.java
java/foreign/TestCircularInit2.java
java/foreign/TestCondy.java
java/foreign/TestDowncall.java
java/foreign/TestFunctionDescriptor.java
java/foreign/TestIntrinsics.java
java/foreign/TestNULLAddress.java
java/foreign/TestNulls.java
java/foreign/TestScopedOperations.java
java/foreign/TestStringEncoding.java
java/foreign/TestUpcall.java
java/foreign/TestUpcallException.java
java/foreign/TestUpcallHighArity.java
java/foreign/TestUpcallStructScope.java
java/foreign/TestVarArgs.java
java/foreign/enablenativeaccess/TestDriver.java#panama_all_unnamed_module_native_access
java/foreign/enablenativeaccess/TestDriver.java#panama_comma_separated_enable
java/foreign/enablenativeaccess/TestDriver.java#panama_comma_separated_enable_invoke
java/foreign/enablenativeaccess/TestDriver.java#panama_comma_separated_enable_reflection
java/foreign/enablenativeaccess/TestDriver.java#panama_enable_native_access
java/foreign/enablenativeaccess/TestDriver.java#panama_enable_native_access_invoke
java/foreign/enablenativeaccess/TestDriver.java#panama_enable_native_access_reflection
java/foreign/handles/Driver.java
java/foreign/malloc/TestMixedMallocFree.java
java/foreign/valist/VaListTest.java
java/foreign/virtual/TestVirtualCalls.java

@psoujany psoujany mentioned this issue May 8, 2023
Merged
@psoujany
Copy link
Contributor

Excluding below tests on z/OS for both JDK11 and JDK17
java/lang/management/MemoryMXBean/MemoryManagementConcMarkSweepGC.sh
java/lang/management/MemoryMXBean/MemoryManagementParallelGC.sh
java/lang/management/MemoryMXBean/MemoryManagementSerialGC.sh
java/lang/management/MemoryMXBean/MemoryTestAllGC.sh
java/lang/management/MemoryMXBean/MemoryTest.java
java/lang/management/MemoryMXBean/LowMemoryTest.java
javax/management/Introspector/ClassLeakTest.java
java/lang/management/MemoryMXBean/MemoryTestZGC.sh
com/sun/management/OperatingSystemMXBean/GetFreePhysicalMemorySize.java
java/nio/channels/FileChannel/directio/WriteDirect.java
java/nio/channels/DatagramChannel/Promiscuous.java
java/lang/management/MemoryMXBean/MemoryManagementConcMarkSweepGC.sh
java/lang/management/MemoryMXBean/MemoryManagementParallelGC.sh
java/lang/management/MemoryMXBean/MemoryManagementSerialGC.sh
java/lang/management/MemoryMXBean/MemoryTestAllGC.sh
java/lang/management/MemoryMXBean/MemoryTest.java
java/lang/management/MemoryMXBean/LowMemoryTest.java
javax/management/Introspector/ClassLeakTest.java
java/lang/management/MemoryMXBean/MemoryTestZGC.sh
com/sun/management/OperatingSystemMXBean/GetFreePhysicalMemorySize.java
java/nio/channels/FileChannel/directio/WriteDirect.java
java/nio/channels/DatagramChannel/Promiscuous.java

@psoujany
Copy link
Contributor

Excluding below tests on JDK17 z/OS
java/foreign/SafeFunctionAccessTest.java
java/foreign/TestNative.java
java/foreign/TestSymbolLookup.java

@psoujany
Copy link
Contributor

psoujany commented Jun 7, 2023 •
edited
Loading

Excluding below tests on JDK17 z/OS
java/foreign/TestVarArgs.java
java/foreign/valist/VaListTest.java
java/foreign/virtual/TestVirtualCalls.java
javax/xml/crypto/dsig/SecureValidation.java
java/nio/channels/AsyncCloseAndInterrupt.java

@psoujany psoujany mentioned this issue Jun 7, 2023
Merged
@babsingh babsingh mentioned this issue Aug 30, 2023
Merged
babsingh added a commit to babsingh/aqa-tests that referenced this issue Sep 19, 2023
@babsingh
[JDK21/22] Permanently disable tests
c7a2395 
MethodExitTest is being permanently disabled. See
eclipse-openj9/openj9#17490 for more details on why MethodExitTest is
being permanently disabled.

But it didn't correctly point to adoptium#1297. It pointed to an OpenJ9 issue.
This PR also corrects the link to adoptium#1297 for MovingCompWindow and
ToggleNotifyJvmtiTest.

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>
babsingh added a commit to babsingh/aqa-tests that referenced this issue Sep 19, 2023
@babsingh
[JDK21/22] Permanently disable tests
94619c4 
MethodExitTest is being permanently disabled. See
eclipse-openj9/openj9#17490 for more details on why MethodExitTest is
being permanently disabled.

MovingCompWindow and ToggleNotifyJvmtiTest were permanently disabled in
issue. This PR also corrects the link to adoptium#1297 for MovingCompWindow and
ToggleNotifyJvmtiTest.

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>
@babsingh babsingh mentioned this issue Sep 19, 2023
Merged
babsingh added a commit to babsingh/aqa-tests that referenced this issue Sep 19, 2023
@babsingh
[JDK21/22] Permanently disable tests
6beaf2b 
MethodExitTest is being permanently disabled. See
eclipse-openj9/openj9#17490 for more details on why
MethodExitTest is being permanently disabled.

MovingCompWindow and ToggleNotifyJvmtiTest were permanently disabled
in adoptium#4737. But it didn't correctly point to adoptium#1297. It pointed to
an OpenJ9 issue. This PR also corrects the link to adoptium#1297 for
MovingCompWindow and ToggleNotifyJvmtiTest.

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>
babsingh added a commit to babsingh/aqa-tests that referenced this issue Sep 19, 2023
@babsingh
[JDK21/22] Permanently disable tests
a5304a6 
MethodExitTest is being permanently disabled. See
eclipse-openj9/openj9#17490 for more details on why
MethodExitTest is being permanently disabled.

MovingCompWindow and ToggleNotifyJvmtiTest were permanently disabled
in adoptium#4737. But it didn't correctly point to adoptium#1297. It
pointed to an OpenJ9 issue. This PR also corrects the link to
adoptium#1297 for MovingCompWindow and ToggleNotifyJvmtiTest.

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>
llxia pushed a commit that referenced this issue Sep 20, 2023
@babsingh
[JDK21/22] Permanently disable tests (#4777)
148a516 
MethodExitTest is being permanently disabled. See
eclipse-openj9/openj9#17490 for more details on why
MethodExitTest is being permanently disabled.

MovingCompWindow and ToggleNotifyJvmtiTest were permanently disabled
in #4737. But it didn't correctly point to #1297. It
pointed to an OpenJ9 issue. This PR also corrects the link to
#1297 for MovingCompWindow and ToggleNotifyJvmtiTest.

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>
@babsingh babsingh mentioned this issue Feb 5, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug
Projects
No open projects
aqa-tests
  
Done
Milestone
August 2019
Development

No branches or pull requests
7 participants
@karianna @smlambert @ChengJin01 @M-Davies @psoujany @andrew-m-leonard @adam-thorpe