Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add TAP pipeline #4285

Merged
merged 1 commit into from
Jan 31, 2023
Merged

Add TAP pipeline #4285

merged 1 commit into from
Jan 31, 2023

Conversation

llxia
Copy link
Contributor

@llxia llxia commented Jan 30, 2023

resolves: #4277
Signed-off-by: Lan Xia Lan_Xia@ca.ibm.com

@llxia
Copy link
Contributor Author

llxia commented Jan 30, 2023

internal Jenkins link

00:00:15.911  ============================
00:00:15.912  list all files in /home/jenkins/workspace/Collect_AQA_TAP/AQAvitTapFiles/x86-64_linux
00:00:15.912  ============================
00:00:15.912  ./Test_openjdk11_j9_extended.functional_x86-64_linux_testList_0.tap
00:00:15.912  ./Test_openjdk11_j9_extended.functional_x86-64_linux_testList_1.tap
00:00:15.912  ./Test_openjdk11_j9_extended.functional_x86-64_linux_testList_2.tap
00:00:15.912  ./Test_openjdk11_j9_extended.jck_x86-64_linux_fips_testList_0.tap
00:00:15.912  ./Test_openjdk11_j9_extended.jck_x86-64_linux_fips_testList_1.tap
00:00:15.912  ./Test_openjdk11_j9_extended.jck_x86-64_linux_fips_testList_2.tap
00:00:15.912  ./Test_openjdk11_j9_extended.jck_x86-64_linux_fips_testList_3.tap
00:00:15.912  ./Test_openjdk11_j9_extended.jck_x86-64_linux_testList_0.tap
00:00:15.912  ./Test_openjdk11_j9_extended.jck_x86-64_linux_testList_1.tap
00:00:15.912  ./Test_openjdk11_j9_extended.jck_x86-64_linux_testList_2.tap
00:00:15.912  ./Test_openjdk11_j9_extended.jck_x86-64_linux_testList_3.tap
00:00:15.912  ./Test_openjdk11_j9_extended.jck_x86-64_linux_testList_4.tap
00:00:15.912  ./Test_openjdk11_j9_extended.jck_x86-64_linux_testList_5.tap
00:00:15.912  ./Test_openjdk11_j9_extended.jck_x86-64_linux_testList_6.tap
00:00:15.912  ./Test_openjdk11_j9_extended.jck_x86-64_linux_testList_7.tap
00:00:15.912  ./Test_openjdk11_j9_extended.openjdk_x86-64_linux_fips.tap
00:00:15.912  ./Test_openjdk11_j9_extended.openjdk_x86-64_linux.tap
00:00:15.912  ./Test_openjdk11_j9_extended.perf_x86-64_linux.tap
00:00:15.912  ./Test_openjdk11_j9_extended.system_x86-64_linux_testList_0.tap
00:00:15.912  ./Test_openjdk11_j9_extended.system_x86-64_linux_testList_1.tap
00:00:15.912  ./Test_openjdk11_j9_extended.system_x86-64_linux_testList_2.tap
00:00:15.912  ./Test_openjdk11_j9_sanity.functional_x86-64_linux_fips_testList_0.tap
00:00:15.912  ./Test_openjdk11_j9_sanity.functional_x86-64_linux_testList_0.tap
00:00:15.912  ./Test_openjdk11_j9_sanity.functional_x86-64_linux_testList_1.tap
00:00:15.912  ./Test_openjdk11_j9_sanity.functional_x86-64_linux_testList_2.tap
00:00:15.912  ./Test_openjdk11_j9_sanity.jck_x86-64_linux_fips_testList_0.tap
00:00:15.912  ./Test_openjdk11_j9_sanity.jck_x86-64_linux_fips_testList_1.tap
00:00:15.913  ./Test_openjdk11_j9_sanity.jck_x86-64_linux_fips_testList_2.tap
00:00:15.913  ./Test_openjdk11_j9_sanity.jck_x86-64_linux_fips_testList_3.tap
00:00:15.913  ./Test_openjdk11_j9_sanity.jck_x86-64_linux_testList_0.tap
00:00:15.913  ./Test_openjdk11_j9_sanity.jck_x86-64_linux_testList_1.tap
00:00:15.913  ./Test_openjdk11_j9_sanity.jck_x86-64_linux_testList_2.tap
00:00:15.913  ./Test_openjdk11_j9_sanity.jck_x86-64_linux_testList_3.tap
00:00:15.913  ./Test_openjdk11_j9_sanity.openjdk_x86-64_linux_fips_testList_0.tap
00:00:15.913  ./Test_openjdk11_j9_sanity.openjdk_x86-64_linux_fips_testList_1.tap
00:00:15.913  ./Test_openjdk11_j9_sanity.openjdk_x86-64_linux_testList_0.tap
00:00:15.913  ./Test_openjdk11_j9_sanity.openjdk_x86-64_linux_testList_1.tap
00:00:15.913  ./Test_openjdk11_j9_sanity.perf_x86-64_linux.tap
00:00:15.913  ./Test_openjdk11_j9_sanity.system_x86-64_linux_testList_0.tap
00:00:15.913  ./Test_openjdk11_j9_sanity.system_x86-64_linux_testList_1.tap
00:00:15.913  ./Test_openjdk11_j9_sanity.system_x86-64_linux_testList_2.tap
00:00:15.913  ./Test_openjdk11_j9_special.functional_x86-64_linux.tap
00:00:15.913  ./Test_openjdk11_j9_special.jck_x86-64_linux_fips.tap
00:00:15.913  ./Test_openjdk11_j9_special.jck_x86-64_linux.tap
00:00:15.913  ./Test_openjdk11_j9_special.system_x86-64_linux_testList_0.tap
00:00:15.913  ./Test_openjdk11_j9_special.system_x86-64_linux_testList_1.tap
00:00:15.913  ./Test_openjdk11_j9_special.system_x86-64_linux_testList_2.tap
00:00:15.913  ./Test_openjdk11_j9_special.system_x86-64_linux_testList_3.tap
00:00:15.913  ./Test_openjdk11_j9_special.system_x86-64_linux_testList_4.tap
00:00:15.913  ============================
00:00:15.913  clean files in /home/jenkins/workspace/Collect_AQA_TAP/AQAvitTapFiles/x86-64_linux
00:00:15.913  ============================
00:00:15.913  List and remove the above *.jck_* ...
00:00:15.913  ./Test_openjdk11_j9_extended.jck_x86-64_linux_fips_testList_0.tap
00:00:15.913  ./Test_openjdk11_j9_extended.jck_x86-64_linux_fips_testList_1.tap
00:00:15.913  ./Test_openjdk11_j9_extended.jck_x86-64_linux_fips_testList_2.tap
00:00:15.913  ./Test_openjdk11_j9_extended.jck_x86-64_linux_fips_testList_3.tap
00:00:15.913  ./Test_openjdk11_j9_extended.jck_x86-64_linux_testList_0.tap
00:00:15.913  ./Test_openjdk11_j9_extended.jck_x86-64_linux_testList_1.tap
00:00:15.913  ./Test_openjdk11_j9_extended.jck_x86-64_linux_testList_2.tap
00:00:15.913  ./Test_openjdk11_j9_extended.jck_x86-64_linux_testList_3.tap
00:00:15.914  ./Test_openjdk11_j9_extended.jck_x86-64_linux_testList_4.tap
00:00:15.914  ./Test_openjdk11_j9_extended.jck_x86-64_linux_testList_5.tap
00:00:15.914  ./Test_openjdk11_j9_extended.jck_x86-64_linux_testList_6.tap
00:00:15.914  ./Test_openjdk11_j9_extended.jck_x86-64_linux_testList_7.tap
00:00:15.914  ./Test_openjdk11_j9_sanity.jck_x86-64_linux_fips_testList_0.tap
00:00:15.914  ./Test_openjdk11_j9_sanity.jck_x86-64_linux_fips_testList_1.tap
00:00:15.914  ./Test_openjdk11_j9_sanity.jck_x86-64_linux_fips_testList_2.tap
00:00:15.914  ./Test_openjdk11_j9_sanity.jck_x86-64_linux_fips_testList_3.tap
00:00:15.914  ./Test_openjdk11_j9_sanity.jck_x86-64_linux_testList_0.tap
00:00:15.914  ./Test_openjdk11_j9_sanity.jck_x86-64_linux_testList_1.tap
00:00:15.914  ./Test_openjdk11_j9_sanity.jck_x86-64_linux_testList_2.tap
00:00:15.914  ./Test_openjdk11_j9_sanity.jck_x86-64_linux_testList_3.tap
00:00:15.914  ./Test_openjdk11_j9_special.jck_x86-64_linux.tap
00:00:15.914  ./Test_openjdk11_j9_special.jck_x86-64_linux_fips.tap
00:00:15.914  List and remove the above *_special.system_* ...
00:00:15.914  ./Test_openjdk11_j9_special.system_x86-64_linux_testList_0.tap
00:00:15.914  ./Test_openjdk11_j9_special.system_x86-64_linux_testList_1.tap
00:00:15.914  ./Test_openjdk11_j9_special.system_x86-64_linux_testList_2.tap
00:00:15.914  ./Test_openjdk11_j9_special.system_x86-64_linux_testList_3.tap
00:00:15.914  ./Test_openjdk11_j9_special.system_x86-64_linux_testList_4.tap
00:00:15.914  List and remove the above *.external_* ...
00:00:15.914  List and remove the above *_dev.* ...
00:00:15.914  List and remove the above .DS_Store ...
00:00:16.348  List and remove the above *_fips* ...
00:00:16.348  ./Test_openjdk11_j9_extended.openjdk_x86-64_linux_fips.tap
00:00:16.348  ./Test_openjdk11_j9_sanity.functional_x86-64_linux_fips_testList_0.tap
00:00:16.348  ./Test_openjdk11_j9_sanity.openjdk_x86-64_linux_fips_testList_0.tap
00:00:16.348  ./Test_openjdk11_j9_sanity.openjdk_x86-64_linux_fips_testList_1.tap
00:00:16.348  Print empty dir ...
00:00:16.348  Delete empty dir ...
00:00:16.348  ============================
00:00:16.348  list AQAvit TAP files in /home/jenkins/workspace/Collect_AQA_TAP/AQAvitTapFiles/x86-64_linux
00:00:16.348  ============================
00:00:16.348  1. List sanity.openjdk ...
00:00:16.348  Test_openjdk11_j9_sanity.openjdk_x86-64_linux_testList_0.tap
00:00:16.348  Test_openjdk11_j9_sanity.openjdk_x86-64_linux_testList_1.tap
00:00:16.348  2. List extended.openjdk ...
00:00:16.348  Test_openjdk11_j9_extended.openjdk_x86-64_linux.tap
00:00:16.348  3. List sanity.functional ...
00:00:16.348  Test_openjdk11_j9_sanity.functional_x86-64_linux_testList_0.tap
00:00:16.348  Test_openjdk11_j9_sanity.functional_x86-64_linux_testList_1.tap
00:00:16.348  Test_openjdk11_j9_sanity.functional_x86-64_linux_testList_2.tap
00:00:16.348  4. List extended.functional ...
00:00:16.348  Test_openjdk11_j9_extended.functional_x86-64_linux_testList_0.tap
00:00:16.348  Test_openjdk11_j9_extended.functional_x86-64_linux_testList_1.tap
00:00:16.348  Test_openjdk11_j9_extended.functional_x86-64_linux_testList_2.tap
00:00:16.348  5. List special.functional ...
00:00:16.348  Test_openjdk11_j9_special.functional_x86-64_linux.tap
00:00:16.348  6. List sanity.system ...
00:00:16.348  Test_openjdk11_j9_sanity.system_x86-64_linux_testList_0.tap
00:00:16.348  Test_openjdk11_j9_sanity.system_x86-64_linux_testList_1.tap
00:00:16.348  Test_openjdk11_j9_sanity.system_x86-64_linux_testList_2.tap
00:00:16.348  7. List extended.openjdk ...
00:00:16.348  Test_openjdk11_j9_extended.system_x86-64_linux_testList_0.tap
00:00:16.348  Test_openjdk11_j9_extended.system_x86-64_linux_testList_1.tap
00:00:16.348  Test_openjdk11_j9_extended.system_x86-64_linux_testList_2.tap
00:00:16.348  8. List sanity.perf ...
00:00:16.348  Test_openjdk11_j9_sanity.perf_x86-64_linux.tap
00:00:16.348  9. List extended.perf ...
00:00:16.348  Test_openjdk11_j9_extended.perf_x86-64_linux.tap
00:00:16.348  ============================
00:00:16.349  List failed tests in /home/jenkins/workspace/Collect_AQA_TAP/AQAvitTapFiles/x86-64_linux
00:00:16.349  ============================
00:00:16.349  ./Test_openjdk11_j9_sanity.functional_x86-64_linux_testList_0.tap:not ok 16 - cmdLineTester_jvmtitests_8

@llxia llxia marked this pull request as ready for review January 30, 2023 18:11
Copy link
Contributor

@renfeiw renfeiw left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM


usage ()
{
echo 'Usage : aqaTAp.sh --url <link to download TAP files> --dir <dir to store TAP files>'
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
echo 'Usage : aqaTAp.sh --url <link to download TAP files> --dir <dir to store TAP files>'
echo 'Usage : aqaTap.sh --url <link to download TAP files> --dir <dir to store TAP files>'

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks. I will update.

@@ -0,0 +1,183 @@
#!/usr/bin/env bash
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Has this file been shellchecked?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is that a requirement? If so, do we have a doc for instruction?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I ran the script at https://www.shellcheck.net/ and updated the script if the suggestion is applicable.

@llxia llxia force-pushed the test9 branch 4 times, most recently from 69625e6 to 2181647 Compare January 30, 2023 21:38
Copy link
Contributor

@smlambert smlambert left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Lan, I likely am missing something in the setup of the pipeline at https://ci.adoptopenjdk.net/view/Test_grinder/job/TAP_verification/ in order to test this PR. If you have a moment to take a quick look. I can not see your internal job.

Comment on lines 7 to 9
def TARGETS = params.TARGETS.trim().split("\\s*,\\s*");
def LABEL = (params.LABEL) ?: ""
def LABEL_ADDITION = (params.LABEL_ADDITION) ?: ""
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are TARGETS and LABEL_ADDITION used/needed?

Copy link
Contributor Author

@llxia llxia Jan 31, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  • https://ci.adoptopenjdk.net/view/Test_grinder/job/TAP_verification/11/console does not work because this PR has not been merged. aqaTap.sh does not exist in master. I can do a demo this afternoon.
  • TARGETS is intended for future use. I would like users to provide what TARGET they want to check, not just be limited to the predefined AQA 9 targets.
  • yes, LABEL_ADDITION is not needed. It should be removed.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have pointed the main config to your branch (where aqaTap.sh exists), but realize I need to run with CUSTOMIZED_SDK_URL_CREDENTIAL_ID.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ah, your fork is openjdk-tests, not aqa-tests, I see my testing dilemna !

resolves: adoptium#4277
Signed-off-by: Lan Xia <Lan_Xia@ca.ibm.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Create pipeline to gather TAP files for AQAvit verification
4 participants