Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Exclude jdk_net related failed tests temporarily #2282

Merged
merged 1 commit into from
Feb 17, 2021

Conversation

LongyuZhang
Copy link
Contributor

  • exclude jdk_net failed tests temporarily
  • for jdk 11, 15, and 16 on related platforms
  • related issues are listed with each excluded test

Signed-off-by: Longyu Zhang longyu.zhang@ibm.com

- exclude jdk_net failed tests temporarily
- for jdk 11, 15, and 16 on related  platforms

Signed-off-by: Longyu Zhang <longyu.zhang@ibm.com>
@LongyuZhang
Copy link
Contributor Author

LongyuZhang commented Feb 17, 2021

Test Links:
hotspot:

  • JDK 11, 15, 16
  • x86-64_linux, ppc64_aix, x86-64_mac, s390x_linux

openj9:

  • JDK 11,15,16
  • x86-64_linux, ppc64_aix, x86-64_mac, s390x_linux

https://ci.adoptopenjdk.net/view/Test_grinder/job/Grinder/

  • 7044 6994 6989 6985 6914 6912 6909 6907 6764 6763 6761-6755 6751-6746 6744 6741 6740

@smlambert smlambert merged commit e8addfd into adoptium:master Feb 17, 2021
@karianna karianna added this to TODO in aqa-tests via automation Feb 17, 2021
@karianna karianna added the bug label Feb 17, 2021
@karianna karianna added this to the February 2021 milestone Feb 17, 2021
@karianna karianna moved this from TODO to Done in aqa-tests Feb 17, 2021
patkarns added a commit to patkarns/openjdk-tests that referenced this pull request Mar 4, 2021
* Add add-exports to HCRLateAttachWorkload_previewEnabled (adoptium#2208)

- Add add-exports to HCRLateAttachWorkload_previewEnabled

Signed-off-by: Longyu Zhang <longyu.zhang@ibm.com>

* Convert iteration based STF based load tests to time-based tests (adoptium#2203)

Signed-off-by: Mesbah_Alam@ca.ibm.com <Mesbah_Alam@ca.ibm.com>

* AUTO: auto exclude test jdk_foreign_native impl=openj9 ver=16+ (adoptium#2219)

- related: adoptium#2218 (comment)

Signed-off-by: GitHub <noreply@github.com>

Co-authored-by: smlambert <smlambert@users.noreply.github.com>

* get.sh: stop mandating GNU tar --strip when extracting debug images (adoptium#2184)

Signed-off-by: Stewart X Addison <sxa@redhat.com>

* Remove references to eclipse-openj9/openj9#11135 (adoptium#2215)

eclipse-openj9/openj9#11135 refers to an uber issue, which will be closed soon.
So, the references to eclipse-openj9/openj9#11135 have been replaced with
stand-alone trackers for the respective issues.

Also, a duplicate for SuperMethodTest.java has been removed.

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>

* Exclude ChaCha20/ChaCha20Poly1305ParamTest.java (adoptium#2221)

Issue eclipse-openj9/openj9#11689

Signed-off-by: Peter Shipton <Peter_Shipton@ca.ibm.com>

* Update OpenJ9 JDK17 exclude list (adoptium#2217)

* Apply adoptium#2188 to OpenJ9 JDK17 exclude list

Apply adoptium#2188 to OpenJ9 JDK17 exclude list.

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>

* Apply adoptium#2192 to OpenJ9 JDK17 exclude list

Apply adoptium#2192 to OpenJ9 JDK17 exclude list.

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>

* Apply adoptium#2215 to OpenJ9 JDK17 exclude list

Apply adoptium#2215 to OpenJ9 JDK17 exclude list.

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>

* Fix charsets,i18n,language_tag and locale_matching for 16 and Create new 4 test cases (adoptium#2214)

Co-authored-by: Kentaro Kuramochi <aa324442@KentaronoMacBook-Air.local>

* Allow users to set lightweight option (adoptium#2216)

The benefit of having lightweight checkout is to save space on Jenkins master.
However, Jenkins does not support using Repository URL and Branch build parameters with lightweight checkout together (see https://issues.jenkins.io/browse/JENKINS-48431).

In this PR, we set LIGHT_WEIGHT_CEHCKOUT to false and use Repository URL and Branch as build parameters by default. If LIGHT_WEIGHT_CEHCKOUT is set to true, set Repository URL and Branch to its explicit value

Signed-off-by: lanxia <lan_xia@ca.ibm.com>

* Create ParallelStreamsLoadTest (adoptium#2229)

Signed-off-by: Simon Rushton <srushton@redhat.com>

* Remove _5m from ParallelStreamsLoadTest targets (adoptium#2231)

Signed-off-by: Simon Rushton <srushton@redhat.com>

* Enable java/lang/reflect/DefaultMethodMembers/FilterNotMostSpecific.java (adoptium#2230)

This was forgot after resolving openj9 issue #7623

Signed-off-by: Jason Feng <fengj@ca.ibm.com>

* Merge openj9_custom into jdk_custom (adoptium#2232)

- Remove openj9_custom to merge it into jdk_custom

Signed-off-by: Longyu Zhang <longyu.zhang@ibm.com>

* Move JdiTest playlist entry from lambdaLoadTest to otherLoadTest (adoptium#2233)

Signed-off-by: Simon Rushton <srushton@redhat.com>

* Reinstate ChaCha20Poly1305ParamTest (adoptium#2236)

Issue eclipse-openj9/openj9#11689

Signed-off-by: Peter Shipton <Peter_Shipton@ca.ibm.com>

* Replace deprecated triggers with new syntax (adoptium#2237)

See https://github.com/jenkinsci/job-dsl-plugin/blob/master/docs/Migration.md#migrating-to-177

Signed-off-by: Adam Brousseau <adam.brousseau88@gmail.com>

* Update userGuide to include vendor disable feature (adoptium#2239)

Signed-off-by: renfeiw <renfeiw@ca.ibm.com>

* Use the new format of disable in playlist file (adoptium#2240)

Signed-off-by: renfeiw <renfeiw@ca.ibm.com>

* Add a custom playlist target to run system tests (adoptium#2234)

Signed-off-by: Mesbah_Alam@ca.ibm.com <Mesbah_Alam@ca.ibm.com>

* OpenJ9 AArch64: Enable a BigInteger test back again (adoptium#2242)

This commit enables the following test, which used to fail with timeouts
on AArch64:

- java/math/BigInteger/LargeValueExceptions.java (eclipse-openj9/openj9#9082)

Signed-off-by: KONNO Kazuhiro <konno@jp.ibm.com>

* OpenJ9 AArch64: excluding stream/CountLargeTest (adoptium#2243)

The following test is known to timeout with OpenJ9 AArch64.
This commit excludes it.

- java/util/stream/test/org/openjdk/tests/java/util/stream/CountLargeTest.java eclipse-openj9/openj9#9040

Signed-off-by: KONNO Kazuhiro <konno@jp.ibm.com>

* Allow test autogen user to specify parallel params (adoptium#2248)

- Param PARALLEL_DEFAULT will be set as default
  PARALLEL option
- Param NUM_MACHINES will be set if passed

Signed-off-by: Adam Brousseau <adam.brousseau88@gmail.com>

* Exclude com/sun/crypto AEAD ByteBuffer tests (adoptium#2249)

Issue eclipse-openj9/openj9#11390

Signed-off-by: Peter Shipton <Peter_Shipton@ca.ibm.com>

* Fix command injection vulnerability in autoTestPR (adoptium#2244)

Fixes a command injection vulnerability with the auto test PR GitHub Workflow.

See https://securitylab.github.com/research/github-actions-untrusted-input

Also removes the unecessary `&& github.event_name != 'pull_request'` condition from the autoTestPR job because it will always be satisfied. (This workflow only triggers upon issue_comment, so `github.event_name` will never be 'pull_request')

* Update the userGuide (adoptium#2259)

- add a one line to cover the special case of auto disable

Signed-off-by: renfeiw <renfeiw@ca.ibm.com>

* Add certain directories trigger for PR/push testing (adoptium#2241)

* Add certain directories trigger for PR/push testing

* use run-aqa with the target specified by the changed dirs

* remove unnecessary push trigger, leave only PR trigger

* merge openj9 and hotspot, deal with duplication situation

* Combine getChangeLocation and getBuildLists into one getBuildLists, remove unnecessary code

Co-authored-by: xichen1 <pan.chstu@gmail.com>

* Add 1 hour timeouts to all copyArtifacts steps (adoptium#2261)

Avoid long hanging builds when copyArtifacts hangs

Signed-off-by: Adam Brousseau <adam.brousseau88@gmail.com>

* Set Lightweight checkout on child jobs (adoptium#2251)

Pass along the LIGHT_WEIGHT_CHECKOUT parameter
to the generater in order to have children
with the same value. Generally this will be false
for Ginders and true eveywhere else

Fixes adoptium#2250

Signed-off-by: Adam Brousseau <adam.brousseau88@gmail.com>

* Revert "Exclude com/sun/crypto AEAD ByteBuffer tests (adoptium#2249)" (adoptium#2266)

This reverts commit 2227228.

* AUTO: auto exclude test dacapo-jython impl=openj9 ver=16+ (adoptium#2269)

- related: adoptium#2256 (comment)

Signed-off-by: GitHub <noreply@github.com>

Co-authored-by: smlambert <smlambert@users.noreply.github.com>

* Only pass LIGHTWEIGHT to DSL if defined (adoptium#2270)

- Currently it will put NULL which will cause
  toBoolean() to fail

Related adoptium#2251

Signed-off-by: Adam Brousseau <adam.brousseau88@gmail.com>

* Add jdk_vector for jdk16+ (adoptium#2267)

Signed-off-by: lanxia <lan_xia@ca.ibm.com>

* AUTO: auto exclude test jdk_foreign_native plat=.*(ppc|arm|390).* (adoptium#2280)

- related: adoptium#2265 (comment)

Signed-off-by: GitHub <noreply@github.com>

Co-authored-by: adamfarley <adamfarley@users.noreply.github.com>

* temporarily fix bug of get changed files (adoptium#2277)

* Exclude jdk_net related failed tests temporarily (adoptium#2282)

- exclude jdk_net failed tests temporarily
- for jdk 11, 15, and 16 on related  platforms

Signed-off-by: Longyu Zhang <longyu.zhang@ibm.com>

* add suffix to ignore native tests (adoptium#2283)

* add suffix to ignore native tests

* remove unnecessary matrix.bulid_list in target list

* Remove maketest.sh (adoptium#2285)

Signed-off-by: Mesbah_Alam@ca.ibm.com <Mesbah_Alam@ca.ibm.com>

* Add comment-triggered PR build action (adoptium#2222)

* Add comment-triggered PR build action (adoptium#2199)

Add workflow `action.yml` that triggers on a PR comment starting with the word `action` then runs AQA tests based on the parameters.
Add `action_argparse.py` that parses PR comments to determine the parameters for AQA tests in the `action.yml` workflow.

Co-authored-by: Xichen Pan <xichen.pan@gmail.com>
Co-authored-by: patkarns <30379111+patkarns@users.noreply.github.com>

* Update indentation for exclusion user guide (adoptium#2288)

Signed-off-by: renfeiw <renfeiw@ca.ibm.com>

* Fix reportStatus job running on every comment (adoptium#2290)

Prevents reportStatus from running on every comment by checking for the same conditions as parseComment:
- The comment must begin with `run aqa` keyword
- The comment must be a PR comment

* Use any node for copying TAP files in parallel test builds (adoptium#2295)

Resolve: adoptium#2262

Signed-off-by: lanxia <lan_xia@ca.ibm.com>

* Set ulimit for sharedclasscache multithread tests (adoptium#2274)

Signed-off-by: Simon Rushton <srushton@redhat.com>

* Add test excluded label for auto exclusion (adoptium#2300)

Signed-off-by: renfeiw <renfeiw@ca.ibm.com>

* Change subset to version (adoptium#2301)

Signed-off-by: renfeiw <renfeiw@ca.ibm.com>

* Fix GitHub head ref error (adoptium#2308)

* test error

* test error

* remove parentheses

* use github.head_ref

* remove test file

* Update userGuide to change subset to version (adoptium#2307)

Signed-off-by: renfeiw <renfeiw@ca.ibm.com>

* remove PushOrPRtestbuild.yml (adoptium#2309)

* Add alpine-linux and x86-64_solaris platforms (adoptium#2304)

* Trial external_custom target

Signed-off-by: Shelley Lambert <slambert@gmail.com>

* Update build.xml

Signed-off-by: Shelley Lambert <slambert@gmail.com>

* Add alpine-linux platform label

Signed-off-by: Shelley Lambert <slambert@gmail.com>

* add bits

Signed-off-by: Shelley Lambert <slambert@gmail.com>

* Add x86_solaris

Signed-off-by: Shelley Lambert <slambert@gmail.com>

* Remove waitForANodeToBecomeActive post-parallel (adoptium#2312)

This step is unnecessary now that we run
on any node. Also remove function as it
was only used for this step.

Follow up to adoptium#2295

Signed-off-by: Adam Brousseau <adam.brousseau88@gmail.com>

* Remove ParallelStreamsLoadTest_special_J9 long running modes 113, 614 (adoptium#2315)

Modes 113 and 614 take too long to run across all platforms, and
contribute to special.system timeout problems on Windows.

(5) 113: -Xgcpolicy:gencon
-Xjit:count=0,optlevel=warm,gcOnResolve,rtResolve -Xmn512k
-Xnocompressedrefs
aix 8: 23min, 11: 31min
osx 8: 10min, 11: 20min
plinux 8: 18min, 11: 23min
xlinux 8: 25min, 11: 40min
zlinux 8: 12min, 11: 14min
Windows 11: 30min

(20) 614: -Xcompressedrefs -Xgcpolicy:gencon -Xjit:counts="- - - - - - 1
1 1 1000 250 250 - - - 10000 100000
10000",gcOnResolve,rtResolve,sampleInterval=2,scorchingSampleThreshold=10000,quickProfile
-Xmn512k -Xcheck:gc:vmthreads:all:quiet
aix 8: 19min, 11: 27min
osx 8: 17min, 11: 17min
plinux 8: 18min, 11: 22min
xlinux 8: 24min, 11: 33min
zlinux 8: 10min, 11: 14min
Windows 11: 27min

Signed-off-by: Peter Shipton <Peter_Shipton@ca.ibm.com>

* Change Renaissance 0.9.0 to 0.11.0 in build.xml (adoptium#2314)

Fixes adoptium#2298

* Disable ParallelStreamsLoadTest slow OSRG modes on Windows (adoptium#2316)

The OSRG modes run slow only on Windows, and contribute to Windows
special.system tests timing out. The Mode Mode107-OSRG (24) can timeout
the 60min limit and fail.

Issue eclipse-openj9/openj9#11904

variation: (24) Mode107-OSRG
JVM_OPTIONS:  -Xgcpolicy:optthruput -Xdebug
-Xrunjdwp:transport=dt_socket,address=8888,server=y,onthrow=no.pkg.foo,launch=echo
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
Windows 11: 67min
aix 8: 9min, 11: 4min
osx 8: 3min, 11: 5min
plinux 8: 2min, 11: 4min
xlinux 8: 4min, 11: 10min
zlinux 8: 4min, 11: 6min

variation: (25) Mode110-OSRG
JVM_OPTIONS:
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
-Xgcpolicy:gencon
Windows 11: 32min
aix 8: 4min, 11: 5min
osx 8: 3min, 11: 2min
plinux 8: 4min, 11: 5min
xlinux 8: 4min, 11: 6min
zlinux 8: 1min, 11: 2min

variation: (26) Mode610-OSRG
JVM_OPTIONS:  -Xcompressedrefs
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
-Xgcpolicy:gencon
Windows 11: 25min
aix 8: 4min, 11: 5min
osx 8: 3min, 11: 2min
plinux 8: 3min, 11: 4min
xlinux 8: 5min, 11: 6min
zlinux 8: 2min, 11: 2min

variation: (27) Mode612-OSRG
JVM_OPTIONS:  -Xcompressedrefs -Xgcpolicy:gencon
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
Windows 11: 33min
aix 8: 4min, 11: 5min
osx 8: 2min, 11: 4min
plinux 8: 3min, 11: 5min
xlinux 8: 4min, 11: 6min
zlinux 8: 1min, 11: 2min

Signed-off-by: Peter Shipton <Peter_Shipton@ca.ibm.com>

* AUTO: auto exclude test renaissance-dec-tree ver=16+ (adoptium#2319)

- related: adoptium#2255 (comment)

Signed-off-by: GitHub <noreply@github.com>

Co-authored-by: smlambert <smlambert@users.noreply.github.com>

* Disable ParallelStreamsLoadTest slow OSRG modes on Windows (adoptium#2325)

Fixes adoptium#2316 (comment)

The OSRG modes run slow only on Windows, and contribute to Windows
special.system tests timing out. The Mode Mode107-OSRG (24) can timeout
the 60min limit and fail.

Issue eclipse-openj9/openj9#11904

variation: (24) Mode107-OSRG
JVM_OPTIONS:  -Xgcpolicy:optthruput -Xdebug
-Xrunjdwp:transport=dt_socket,address=8888,server=y,onthrow=no.pkg.foo,launch=echo
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
Windows 11: 67min
aix 8: 9min, 11: 4min
osx 8: 3min, 11: 5min
plinux 8: 2min, 11: 4min
xlinux 8: 4min, 11: 10min
zlinux 8: 4min, 11: 6min

variation: (25) Mode110-OSRG
JVM_OPTIONS:
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
-Xgcpolicy:gencon
Windows 11: 32min
aix 8: 4min, 11: 5min
osx 8: 3min, 11: 2min
plinux 8: 4min, 11: 5min
xlinux 8: 4min, 11: 6min
zlinux 8: 1min, 11: 2min

variation: (26) Mode610-OSRG
JVM_OPTIONS:  -Xcompressedrefs
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
-Xgcpolicy:gencon
Windows 11: 25min
aix 8: 4min, 11: 5min
osx 8: 3min, 11: 2min
plinux 8: 3min, 11: 4min
xlinux 8: 5min, 11: 6min
zlinux 8: 2min, 11: 2min

variation: (27) Mode612-OSRG
JVM_OPTIONS:  -Xcompressedrefs -Xgcpolicy:gencon
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
Windows 11: 33min
aix 8: 4min, 11: 5min
osx 8: 2min, 11: 4min
plinux 8: 3min, 11: 5min
xlinux 8: 4min, 11: 6min
zlinux 8: 1min, 11: 2min

Signed-off-by: Peter Shipton <Peter_Shipton@ca.ibm.com>

* Set parallel machine limit to the total number of machines (adoptium#2330)

Resolve: eclipse-openj9/openj9#12088
Signed-off-by: lanxia <lan_xia@ca.ibm.com>

* Convert subset to version (adoptium#2329)

- using version in playlists

Signed-off-by: renfeiw <renfeiw@ca.ibm.com>

* Handle a git command's request for a username on Windows (adoptium#2287)

If we call git ls-remote on Window, when the repo doesn't exist,
the command asks for a username and hangs.

This change disables the request for a username and provides more
useful error messages. It also handles the problem appropriately,
so instead of failing the build, it correctly sets the repo location
to the non-'u' version.

Added some timeout-handling code as well, in case someone's running
this on a version of git older than 2.3, which may ignore the env
var we're using to suppress the username request.

Signed-off-by: Adam Farley <adfarley@redhat.com>

* OpenJ9 JDK17 Exclude java/lang/Thread/UncaughtExceptionsTest.java (adoptium#2333)

Signed-off-by: Jason Feng <fengj@ca.ibm.com>

* Only run foreign native test on x86_64 or aarch64 platforms (adoptium#2334)

This test requires CLinker, and the upstream community has no
current intention to port it to new platforms. So we need to exclude
the test on platforms that aren't x86-64 or aarch64.

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Enable download testimage for jdk8 (adoptium#2320)

Signed-off-by: Sophia Guo <sophia.gwf@gmail.com>

* Ignore leading and trailing whitespace in parsing (adoptium#2318)

Also simplifies the mapping of comment/command arguments to outputs.

* os upate to latest (adoptium#2331)

* use sw.os.alpine-linux label instead of sw.os.musl for Alpine (adoptium#2336)

Signed-off-by: Stewart X Addison <sxa@redhat.com>

Co-authored-by: LongyuZhang <longyu.zhang@ibm.com>
Co-authored-by: Mesbah Alam <Mesbah_Alam@ca.ibm.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: smlambert <smlambert@users.noreply.github.com>
Co-authored-by: Stewart X Addison <6487691+sxa@users.noreply.github.com>
Co-authored-by: Babneet Singh <babsingh@users.noreply.github.com>
Co-authored-by: Peter Shipton <Peter_Shipton@ca.ibm.com>
Co-authored-by: KKES335 <48511024+KKES335@users.noreply.github.com>
Co-authored-by: Kentaro Kuramochi <aa324442@KentaronoMacBook-Air.local>
Co-authored-by: Lan Xia <Lan_Xia@ca.ibm.com>
Co-authored-by: Simon Rushton <srushton@redhat.com>
Co-authored-by: Jason Feng <fengj@ca.ibm.com>
Co-authored-by: AdamBrousseau <adam.brousseau88@gmail.com>
Co-authored-by: Renfei Wang <renfeiw@ca.ibm.com>
Co-authored-by: KONNO Kazuhiro <33821890+knn-k@users.noreply.github.com>
Co-authored-by: Deric Cheung <cheung.deric@gmail.com>
Co-authored-by: XichenPan <xichen.pan@gmail.com>
Co-authored-by: xichen1 <pan.chstu@gmail.com>
Co-authored-by: adamfarley <adamfarley@users.noreply.github.com>
Co-authored-by: yanshan24 <43100949+yanshan24@users.noreply.github.com>
Co-authored-by: Shelley Lambert <smlamber@ca.ibm.com>
Co-authored-by: YananW <40300331+xfxcwynlc@users.noreply.github.com>
Co-authored-by: Adam Farley <adfarley@redhat.com>
Co-authored-by: sophia-guo <sophia.gwf@gmail.com>
smlambert added a commit that referenced this pull request Apr 28, 2021
* Create createTestList.py

* Delete createTestList.py

* Sync original repo (#5)

* Add add-exports to HCRLateAttachWorkload_previewEnabled (#2208)

- Add add-exports to HCRLateAttachWorkload_previewEnabled

Signed-off-by: Longyu Zhang <longyu.zhang@ibm.com>

* Convert iteration based STF based load tests to time-based tests (#2203)

Signed-off-by: Mesbah_Alam@ca.ibm.com <Mesbah_Alam@ca.ibm.com>

* AUTO: auto exclude test jdk_foreign_native impl=openj9 ver=16+ (#2219)

- related: #2218 (comment)

Signed-off-by: GitHub <noreply@github.com>

Co-authored-by: smlambert <smlambert@users.noreply.github.com>

* get.sh: stop mandating GNU tar --strip when extracting debug images (#2184)

Signed-off-by: Stewart X Addison <sxa@redhat.com>

* Remove references to eclipse-openj9/openj9#11135 (#2215)

eclipse-openj9/openj9#11135 refers to an uber issue, which will be closed soon.
So, the references to eclipse-openj9/openj9#11135 have been replaced with
stand-alone trackers for the respective issues.

Also, a duplicate for SuperMethodTest.java has been removed.

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>

* Exclude ChaCha20/ChaCha20Poly1305ParamTest.java (#2221)

Issue eclipse-openj9/openj9#11689

Signed-off-by: Peter Shipton <Peter_Shipton@ca.ibm.com>

* Update OpenJ9 JDK17 exclude list (#2217)

* Apply #2188 to OpenJ9 JDK17 exclude list

Apply #2188 to OpenJ9 JDK17 exclude list.

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>

* Apply #2192 to OpenJ9 JDK17 exclude list

Apply #2192 to OpenJ9 JDK17 exclude list.

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>

* Apply #2215 to OpenJ9 JDK17 exclude list

Apply #2215 to OpenJ9 JDK17 exclude list.

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>

* Fix charsets,i18n,language_tag and locale_matching for 16 and Create new 4 test cases (#2214)

Co-authored-by: Kentaro Kuramochi <aa324442@KentaronoMacBook-Air.local>

* Allow users to set lightweight option (#2216)

The benefit of having lightweight checkout is to save space on Jenkins master.
However, Jenkins does not support using Repository URL and Branch build parameters with lightweight checkout together (see https://issues.jenkins.io/browse/JENKINS-48431).

In this PR, we set LIGHT_WEIGHT_CEHCKOUT to false and use Repository URL and Branch as build parameters by default. If LIGHT_WEIGHT_CEHCKOUT is set to true, set Repository URL and Branch to its explicit value

Signed-off-by: lanxia <lan_xia@ca.ibm.com>

* Create ParallelStreamsLoadTest (#2229)

Signed-off-by: Simon Rushton <srushton@redhat.com>

* Remove _5m from ParallelStreamsLoadTest targets (#2231)

Signed-off-by: Simon Rushton <srushton@redhat.com>

* Enable java/lang/reflect/DefaultMethodMembers/FilterNotMostSpecific.java (#2230)

This was forgot after resolving openj9 issue #7623

Signed-off-by: Jason Feng <fengj@ca.ibm.com>

* Merge openj9_custom into jdk_custom (#2232)

- Remove openj9_custom to merge it into jdk_custom

Signed-off-by: Longyu Zhang <longyu.zhang@ibm.com>

* Move JdiTest playlist entry from lambdaLoadTest to otherLoadTest (#2233)

Signed-off-by: Simon Rushton <srushton@redhat.com>

* Reinstate ChaCha20Poly1305ParamTest (#2236)

Issue eclipse-openj9/openj9#11689

Signed-off-by: Peter Shipton <Peter_Shipton@ca.ibm.com>

* Replace deprecated triggers with new syntax (#2237)

See https://github.com/jenkinsci/job-dsl-plugin/blob/master/docs/Migration.md#migrating-to-177

Signed-off-by: Adam Brousseau <adam.brousseau88@gmail.com>

* Update userGuide to include vendor disable feature (#2239)

Signed-off-by: renfeiw <renfeiw@ca.ibm.com>

* Use the new format of disable in playlist file (#2240)

Signed-off-by: renfeiw <renfeiw@ca.ibm.com>

* Add a custom playlist target to run system tests (#2234)

Signed-off-by: Mesbah_Alam@ca.ibm.com <Mesbah_Alam@ca.ibm.com>

* OpenJ9 AArch64: Enable a BigInteger test back again (#2242)

This commit enables the following test, which used to fail with timeouts
on AArch64:

- java/math/BigInteger/LargeValueExceptions.java (eclipse-openj9/openj9#9082)

Signed-off-by: KONNO Kazuhiro <konno@jp.ibm.com>

* OpenJ9 AArch64: excluding stream/CountLargeTest (#2243)

The following test is known to timeout with OpenJ9 AArch64.
This commit excludes it.

- java/util/stream/test/org/openjdk/tests/java/util/stream/CountLargeTest.java eclipse-openj9/openj9#9040

Signed-off-by: KONNO Kazuhiro <konno@jp.ibm.com>

* Allow test autogen user to specify parallel params (#2248)

- Param PARALLEL_DEFAULT will be set as default
  PARALLEL option
- Param NUM_MACHINES will be set if passed

Signed-off-by: Adam Brousseau <adam.brousseau88@gmail.com>

* Exclude com/sun/crypto AEAD ByteBuffer tests (#2249)

Issue eclipse-openj9/openj9#11390

Signed-off-by: Peter Shipton <Peter_Shipton@ca.ibm.com>

* Fix command injection vulnerability in autoTestPR (#2244)

Fixes a command injection vulnerability with the auto test PR GitHub Workflow.

See https://securitylab.github.com/research/github-actions-untrusted-input

Also removes the unecessary `&& github.event_name != 'pull_request'` condition from the autoTestPR job because it will always be satisfied. (This workflow only triggers upon issue_comment, so `github.event_name` will never be 'pull_request')

* Update the userGuide (#2259)

- add a one line to cover the special case of auto disable

Signed-off-by: renfeiw <renfeiw@ca.ibm.com>

* Add certain directories trigger for PR/push testing (#2241)

* Add certain directories trigger for PR/push testing

* use run-aqa with the target specified by the changed dirs

* remove unnecessary push trigger, leave only PR trigger

* merge openj9 and hotspot, deal with duplication situation

* Combine getChangeLocation and getBuildLists into one getBuildLists, remove unnecessary code

Co-authored-by: xichen1 <pan.chstu@gmail.com>

* Add 1 hour timeouts to all copyArtifacts steps (#2261)

Avoid long hanging builds when copyArtifacts hangs

Signed-off-by: Adam Brousseau <adam.brousseau88@gmail.com>

* Set Lightweight checkout on child jobs (#2251)

Pass along the LIGHT_WEIGHT_CHECKOUT parameter
to the generater in order to have children
with the same value. Generally this will be false
for Ginders and true eveywhere else

Fixes #2250

Signed-off-by: Adam Brousseau <adam.brousseau88@gmail.com>

* Revert "Exclude com/sun/crypto AEAD ByteBuffer tests (#2249)" (#2266)

This reverts commit 2227228.

* AUTO: auto exclude test dacapo-jython impl=openj9 ver=16+ (#2269)

- related: #2256 (comment)

Signed-off-by: GitHub <noreply@github.com>

Co-authored-by: smlambert <smlambert@users.noreply.github.com>

* Only pass LIGHTWEIGHT to DSL if defined (#2270)

- Currently it will put NULL which will cause
  toBoolean() to fail

Related #2251

Signed-off-by: Adam Brousseau <adam.brousseau88@gmail.com>

* Add jdk_vector for jdk16+ (#2267)

Signed-off-by: lanxia <lan_xia@ca.ibm.com>

* AUTO: auto exclude test jdk_foreign_native plat=.*(ppc|arm|390).* (#2280)

- related: #2265 (comment)

Signed-off-by: GitHub <noreply@github.com>

Co-authored-by: adamfarley <adamfarley@users.noreply.github.com>

* temporarily fix bug of get changed files (#2277)

* Exclude jdk_net related failed tests temporarily (#2282)

- exclude jdk_net failed tests temporarily
- for jdk 11, 15, and 16 on related  platforms

Signed-off-by: Longyu Zhang <longyu.zhang@ibm.com>

* add suffix to ignore native tests (#2283)

* add suffix to ignore native tests

* remove unnecessary matrix.bulid_list in target list

* Remove maketest.sh (#2285)

Signed-off-by: Mesbah_Alam@ca.ibm.com <Mesbah_Alam@ca.ibm.com>

* Add comment-triggered PR build action (#2222)

* Add comment-triggered PR build action (#2199)

Add workflow `action.yml` that triggers on a PR comment starting with the word `action` then runs AQA tests based on the parameters.
Add `action_argparse.py` that parses PR comments to determine the parameters for AQA tests in the `action.yml` workflow.

Co-authored-by: Xichen Pan <xichen.pan@gmail.com>
Co-authored-by: patkarns <30379111+patkarns@users.noreply.github.com>

* Update indentation for exclusion user guide (#2288)

Signed-off-by: renfeiw <renfeiw@ca.ibm.com>

* Fix reportStatus job running on every comment (#2290)

Prevents reportStatus from running on every comment by checking for the same conditions as parseComment:
- The comment must begin with `run aqa` keyword
- The comment must be a PR comment

* Use any node for copying TAP files in parallel test builds (#2295)

Resolve: #2262

Signed-off-by: lanxia <lan_xia@ca.ibm.com>

* Set ulimit for sharedclasscache multithread tests (#2274)

Signed-off-by: Simon Rushton <srushton@redhat.com>

* Add test excluded label for auto exclusion (#2300)

Signed-off-by: renfeiw <renfeiw@ca.ibm.com>

* Change subset to version (#2301)

Signed-off-by: renfeiw <renfeiw@ca.ibm.com>

* Fix GitHub head ref error (#2308)

* test error

* test error

* remove parentheses

* use github.head_ref

* remove test file

* Update userGuide to change subset to version (#2307)

Signed-off-by: renfeiw <renfeiw@ca.ibm.com>

* remove PushOrPRtestbuild.yml (#2309)

* Add alpine-linux and x86-64_solaris platforms (#2304)

* Trial external_custom target

Signed-off-by: Shelley Lambert <slambert@gmail.com>

* Update build.xml

Signed-off-by: Shelley Lambert <slambert@gmail.com>

* Add alpine-linux platform label

Signed-off-by: Shelley Lambert <slambert@gmail.com>

* add bits

Signed-off-by: Shelley Lambert <slambert@gmail.com>

* Add x86_solaris

Signed-off-by: Shelley Lambert <slambert@gmail.com>

* Remove waitForANodeToBecomeActive post-parallel (#2312)

This step is unnecessary now that we run
on any node. Also remove function as it
was only used for this step.

Follow up to #2295

Signed-off-by: Adam Brousseau <adam.brousseau88@gmail.com>

* Remove ParallelStreamsLoadTest_special_J9 long running modes 113, 614 (#2315)

Modes 113 and 614 take too long to run across all platforms, and
contribute to special.system timeout problems on Windows.

(5) 113: -Xgcpolicy:gencon
-Xjit:count=0,optlevel=warm,gcOnResolve,rtResolve -Xmn512k
-Xnocompressedrefs
aix 8: 23min, 11: 31min
osx 8: 10min, 11: 20min
plinux 8: 18min, 11: 23min
xlinux 8: 25min, 11: 40min
zlinux 8: 12min, 11: 14min
Windows 11: 30min

(20) 614: -Xcompressedrefs -Xgcpolicy:gencon -Xjit:counts="- - - - - - 1
1 1 1000 250 250 - - - 10000 100000
10000",gcOnResolve,rtResolve,sampleInterval=2,scorchingSampleThreshold=10000,quickProfile
-Xmn512k -Xcheck:gc:vmthreads:all:quiet
aix 8: 19min, 11: 27min
osx 8: 17min, 11: 17min
plinux 8: 18min, 11: 22min
xlinux 8: 24min, 11: 33min
zlinux 8: 10min, 11: 14min
Windows 11: 27min

Signed-off-by: Peter Shipton <Peter_Shipton@ca.ibm.com>

* Change Renaissance 0.9.0 to 0.11.0 in build.xml (#2314)

Fixes #2298

* Disable ParallelStreamsLoadTest slow OSRG modes on Windows (#2316)

The OSRG modes run slow only on Windows, and contribute to Windows
special.system tests timing out. The Mode Mode107-OSRG (24) can timeout
the 60min limit and fail.

Issue eclipse-openj9/openj9#11904

variation: (24) Mode107-OSRG
JVM_OPTIONS:  -Xgcpolicy:optthruput -Xdebug
-Xrunjdwp:transport=dt_socket,address=8888,server=y,onthrow=no.pkg.foo,launch=echo
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
Windows 11: 67min
aix 8: 9min, 11: 4min
osx 8: 3min, 11: 5min
plinux 8: 2min, 11: 4min
xlinux 8: 4min, 11: 10min
zlinux 8: 4min, 11: 6min

variation: (25) Mode110-OSRG
JVM_OPTIONS:
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
-Xgcpolicy:gencon
Windows 11: 32min
aix 8: 4min, 11: 5min
osx 8: 3min, 11: 2min
plinux 8: 4min, 11: 5min
xlinux 8: 4min, 11: 6min
zlinux 8: 1min, 11: 2min

variation: (26) Mode610-OSRG
JVM_OPTIONS:  -Xcompressedrefs
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
-Xgcpolicy:gencon
Windows 11: 25min
aix 8: 4min, 11: 5min
osx 8: 3min, 11: 2min
plinux 8: 3min, 11: 4min
xlinux 8: 5min, 11: 6min
zlinux 8: 2min, 11: 2min

variation: (27) Mode612-OSRG
JVM_OPTIONS:  -Xcompressedrefs -Xgcpolicy:gencon
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
Windows 11: 33min
aix 8: 4min, 11: 5min
osx 8: 2min, 11: 4min
plinux 8: 3min, 11: 5min
xlinux 8: 4min, 11: 6min
zlinux 8: 1min, 11: 2min

Signed-off-by: Peter Shipton <Peter_Shipton@ca.ibm.com>

* AUTO: auto exclude test renaissance-dec-tree ver=16+ (#2319)

- related: #2255 (comment)

Signed-off-by: GitHub <noreply@github.com>

Co-authored-by: smlambert <smlambert@users.noreply.github.com>

* Disable ParallelStreamsLoadTest slow OSRG modes on Windows (#2325)

Fixes #2316 (comment)

The OSRG modes run slow only on Windows, and contribute to Windows
special.system tests timing out. The Mode Mode107-OSRG (24) can timeout
the 60min limit and fail.

Issue eclipse-openj9/openj9#11904

variation: (24) Mode107-OSRG
JVM_OPTIONS:  -Xgcpolicy:optthruput -Xdebug
-Xrunjdwp:transport=dt_socket,address=8888,server=y,onthrow=no.pkg.foo,launch=echo
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
Windows 11: 67min
aix 8: 9min, 11: 4min
osx 8: 3min, 11: 5min
plinux 8: 2min, 11: 4min
xlinux 8: 4min, 11: 10min
zlinux 8: 4min, 11: 6min

variation: (25) Mode110-OSRG
JVM_OPTIONS:
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
-Xgcpolicy:gencon
Windows 11: 32min
aix 8: 4min, 11: 5min
osx 8: 3min, 11: 2min
plinux 8: 4min, 11: 5min
xlinux 8: 4min, 11: 6min
zlinux 8: 1min, 11: 2min

variation: (26) Mode610-OSRG
JVM_OPTIONS:  -Xcompressedrefs
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
-Xgcpolicy:gencon
Windows 11: 25min
aix 8: 4min, 11: 5min
osx 8: 3min, 11: 2min
plinux 8: 3min, 11: 4min
xlinux 8: 5min, 11: 6min
zlinux 8: 2min, 11: 2min

variation: (27) Mode612-OSRG
JVM_OPTIONS:  -Xcompressedrefs -Xgcpolicy:gencon
-Xjit:enableOSR,enableOSROnGuardFailure,count=1,disableAsyncCompilation
Windows 11: 33min
aix 8: 4min, 11: 5min
osx 8: 2min, 11: 4min
plinux 8: 3min, 11: 5min
xlinux 8: 4min, 11: 6min
zlinux 8: 1min, 11: 2min

Signed-off-by: Peter Shipton <Peter_Shipton@ca.ibm.com>

* Set parallel machine limit to the total number of machines (#2330)

Resolve: eclipse-openj9/openj9#12088
Signed-off-by: lanxia <lan_xia@ca.ibm.com>

* Convert subset to version (#2329)

- using version in playlists

Signed-off-by: renfeiw <renfeiw@ca.ibm.com>

* Handle a git command's request for a username on Windows (#2287)

If we call git ls-remote on Window, when the repo doesn't exist,
the command asks for a username and hangs.

This change disables the request for a username and provides more
useful error messages. It also handles the problem appropriately,
so instead of failing the build, it correctly sets the repo location
to the non-'u' version.

Added some timeout-handling code as well, in case someone's running
this on a version of git older than 2.3, which may ignore the env
var we're using to suppress the username request.

Signed-off-by: Adam Farley <adfarley@redhat.com>

* OpenJ9 JDK17 Exclude java/lang/Thread/UncaughtExceptionsTest.java (#2333)

Signed-off-by: Jason Feng <fengj@ca.ibm.com>

* Only run foreign native test on x86_64 or aarch64 platforms (#2334)

This test requires CLinker, and the upstream community has no
current intention to port it to new platforms. So we need to exclude
the test on platforms that aren't x86-64 or aarch64.

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Enable download testimage for jdk8 (#2320)

Signed-off-by: Sophia Guo <sophia.gwf@gmail.com>

* Ignore leading and trailing whitespace in parsing (#2318)

Also simplifies the mapping of comment/command arguments to outputs.

* os upate to latest (#2331)

* use sw.os.alpine-linux label instead of sw.os.musl for Alpine (#2336)

Signed-off-by: Stewart X Addison <sxa@redhat.com>

Co-authored-by: LongyuZhang <longyu.zhang@ibm.com>
Co-authored-by: Mesbah Alam <Mesbah_Alam@ca.ibm.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: smlambert <smlambert@users.noreply.github.com>
Co-authored-by: Stewart X Addison <6487691+sxa@users.noreply.github.com>
Co-authored-by: Babneet Singh <babsingh@users.noreply.github.com>
Co-authored-by: Peter Shipton <Peter_Shipton@ca.ibm.com>
Co-authored-by: KKES335 <48511024+KKES335@users.noreply.github.com>
Co-authored-by: Kentaro Kuramochi <aa324442@KentaronoMacBook-Air.local>
Co-authored-by: Lan Xia <Lan_Xia@ca.ibm.com>
Co-authored-by: Simon Rushton <srushton@redhat.com>
Co-authored-by: Jason Feng <fengj@ca.ibm.com>
Co-authored-by: AdamBrousseau <adam.brousseau88@gmail.com>
Co-authored-by: Renfei Wang <renfeiw@ca.ibm.com>
Co-authored-by: KONNO Kazuhiro <33821890+knn-k@users.noreply.github.com>
Co-authored-by: Deric Cheung <cheung.deric@gmail.com>
Co-authored-by: XichenPan <xichen.pan@gmail.com>
Co-authored-by: xichen1 <pan.chstu@gmail.com>
Co-authored-by: adamfarley <adamfarley@users.noreply.github.com>
Co-authored-by: yanshan24 <43100949+yanshan24@users.noreply.github.com>
Co-authored-by: Shelley Lambert <smlamber@ca.ibm.com>
Co-authored-by: YananW <40300331+xfxcwynlc@users.noreply.github.com>
Co-authored-by: Adam Farley <adfarley@redhat.com>
Co-authored-by: sophia-guo <sophia.gwf@gmail.com>

* Update testJobTemplate

Testing param separator

* Update testJobTemplate

adding styles to header

* Update testJobTemplate

Categorized all parameters

* Update testJobTemplate

updated CSS variables

* Update testJobTemplate

* Update testJobTemplate

* Update testJobTemplate

* Update testJobTemplate

* Update testJobTemplate

* Update testJobTemplate

* Update testJobTemplate

* Update testJobTemplate

* Update testJobTemplate

* Update testJobTemplate

* Update testJobTemplate

Testing parameter separator

* Update testJobTemplate

added CSS styles to parameter separators

* Update testJobTemplate to better reflect mockup

* Update testJobTemplate

* update testJobTemplate, added subtitle styling

* fixed typo

* Update testJobTemplate

* Update testJobTemplate

* Update testJobTemplate

* Style parameters in testJobTemplate

* Add link to Grinder Wiki

* edited styling for Grinder wiki link

* edited 'grinder wiki' positioning

* Added padding to 'Grinder Wiki' link

* Updated JDK_BRANCH parameter order

* added spaces back to copyright

* Update some parameters' default values

* Removed extra tab

* Removed Grinder wiki link and separator bg color

* removed extra spaces in testJobTemplate

* added examples in CUSTOM_TARGET

* fixed /n error

* changed multiline string declaration

* added triple quotations around description

* moved CUSTOM_TARGET examples to the right spot

Co-authored-by: LongyuZhang <longyu.zhang@ibm.com>
Co-authored-by: Mesbah Alam <Mesbah_Alam@ca.ibm.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: smlambert <smlambert@users.noreply.github.com>
Co-authored-by: Stewart X Addison <6487691+sxa@users.noreply.github.com>
Co-authored-by: Babneet Singh <babsingh@users.noreply.github.com>
Co-authored-by: Peter Shipton <Peter_Shipton@ca.ibm.com>
Co-authored-by: KKES335 <48511024+KKES335@users.noreply.github.com>
Co-authored-by: Kentaro Kuramochi <aa324442@KentaronoMacBook-Air.local>
Co-authored-by: Lan Xia <Lan_Xia@ca.ibm.com>
Co-authored-by: Simon Rushton <srushton@redhat.com>
Co-authored-by: Jason Feng <fengj@ca.ibm.com>
Co-authored-by: AdamBrousseau <adam.brousseau88@gmail.com>
Co-authored-by: Renfei Wang <renfeiw@ca.ibm.com>
Co-authored-by: KONNO Kazuhiro <33821890+knn-k@users.noreply.github.com>
Co-authored-by: Deric Cheung <cheung.deric@gmail.com>
Co-authored-by: XichenPan <xichen.pan@gmail.com>
Co-authored-by: xichen1 <pan.chstu@gmail.com>
Co-authored-by: adamfarley <adamfarley@users.noreply.github.com>
Co-authored-by: yanshan24 <43100949+yanshan24@users.noreply.github.com>
Co-authored-by: Shelley Lambert <smlamber@ca.ibm.com>
Co-authored-by: YananW <40300331+xfxcwynlc@users.noreply.github.com>
Co-authored-by: Adam Farley <adfarley@redhat.com>
Co-authored-by: sophia-guo <sophia.gwf@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
No open projects
aqa-tests
  
Done
Development

Successfully merging this pull request may close these issues.

None yet

4 participants