Failed to copy artifacts filter spec fix #1830 #1834

douph1 · 2020-06-08T16:39:57Z

About this failed build https://ci.adoptopenjdk.net/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x64-openj9-windowsXL/364/

06:44:54  Copied 0 artifacts from "build-scripts » release » create_installer_windows" build number 4410
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // node
[Pipeline] echo
06:44:54  Execution error: Failed to copy artifacts from build-scripts/release/create_installer_windows with filter: wix/ReleaseDir/OpenJDK*jdk_*_windows_*.msi

https://ci.adoptopenjdk.net/job/build-scripts/job/release/job/create_installer_windows/4410/console
had produce : OpenJDK11U-jdk_x64_windows_openj9_windowsXL_2020-06-05-23-31.msi

At the begining I was thinking the filter was bad because I have only see _windowsXL doesn't match _windows_ .. but there is a _windows_ before _windowsXL .. so the filter must have been matched.

Why OpenJDK*jdk_*_windows_*.msi havn't matched OpenJDK11U-jdk_x64_windows_openj9_windowsXL_2020-06-05-23-31.msi

seeing copyArtifacts filter doc : https://www.jenkins.io/doc/pipeline/steps/copyartifact/

See the @includes of Ant fileset for the exact format.

I have juste tested with ant :

<project name="TestProject" default="testfilter" basedir=".">
    <target name="testfilter">
        <copy todir="/tmp/dst" overwrite="true" verbose="true">
                <fileset dir="/tmp/src" includes="wix/ReleaseDir/OpenJDK*jdk_*_windows_*.msi" />
        </copy>
    </target>
</project>

ant


testfilter:
     [copy] Copying 1 file to /tmp/dst
     [copy] Copying /tmp/src/wix/ReleaseDir/OpenJDK11U-jdk_x64_windows_openj9_windowsXL_2020-06-05-23-31.msi to /tmp/dst/wix/ReleaseDir/OpenJDK11U-jdk_x64_windows_openj9_windowsXL_2020-06-05-23-31.msi

BUILD SUCCESSFUL
Total time: 0 seconds

Either copyartifact don't exactly use exact filter format as Ant fileset @includes
either the filter was not the problem.

The text was updated successfully, but these errors were encountered:

douph1 · 2020-06-08T17:04:20Z

I thinking it must have matched like this when there was the first error : OpenJDK(11U-)jdk_(x64)_windows_(openj9_windowsXL_2020-06-05-23-31).msi

M-Davies · 2020-06-09T08:38:31Z

For the record, the failed match was on build-azure-win2012r2-x64-2. Later builds seem to be doing better, one on the same machine which passed.

@karianna was changing up how we copy artefacts from build to build yesterday. It's possible this may have fixed it. I'll keep an eye on it over the next week to see if this reoccurs

M-Davies · 2020-06-10T10:39:59Z

Later builds look ok. I'm going to put this under "fixed by copy artifact" changes. This can always be reopened if we see it again

M-Davies · 2020-06-11T08:40:40Z

This is strange. It seems to be an intermittent problem I'm seeing in the build scripts.

I've seen two instances of this in the nightlies last night

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk14u/job/jdk14u-windows-x64-openj9/105/console (Installer ran green) failed with this

04:37:24  Execution error: Failed to copy artifacts from build-scripts/release/create_installer_windows with filter: wix/ReleaseDir/OpenJDK*jdk_*_windows*.msi

But a build two days before that, passed https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk14u/job/jdk14u-windows-x64-openj9/103/console

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x64-openj9-windowsXL/371/console (Installer ran green again) failed with the same error as above. Again, the build two days before passed https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x64-openj9-windowsXL/369/

Keeping in mind my changes to windows installer went in over a week ago (except for #1830), I don't think it's due to that.

A cause could be the filter path. I'm seeing

Done Adding Additional Store
Successfully signed: ReleaseDir\OpenJDK11-jdk_x64_windows_openj9-11.0.8.6.msi

Done Adding Additional Store
Successfully signed: ReleaseDir\OpenJDK11-jdk_x64_windows_openj9-11.0.8.6.msi

in https://ci.adoptopenjdk.net/job/build-scripts/job/release/job/create_installer_windows/4565/console and

Done Adding Additional Store
Successfully signed: ReleaseDir\OpenJDK14-jdk_x64_windows_openj9-14.0.1.7.msi

Done Adding Additional Store
Successfully signed: ReleaseDir\OpenJDK14-jdk_x64_windows_openj9-14.0.1.7.msi

in https://ci.adoptopenjdk.net/job/build-scripts/job/release/job/create_installer_windows/4563/console (the same installer jobs ran for the builds I linked above).

So to resolve this, I'm guessing I would need to update the filter to be ReleaseDir/OpenJDK*jdk_*_windows*.msi but that doesn't explain why other jobs, like this one manage to copy the artifacts over fine.

@douph1 Any ideas?

M-Davies · 2020-06-11T09:12:11Z

I'm testing the theory I mentioned above with a temp PR #1856

karianna · 2020-06-11T09:27:43Z

Also see #1858

M-Davies · 2020-06-11T11:38:10Z

I'm testing the theory I mentioned above with a temp PR #1856

Test theory wasn't successful

M-Davies · 2020-06-16T08:43:07Z

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x64-hotspot/641/console
https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk14u/job/jdk14u-windows-x86-32-hotspot/109/console

22:35:58  Copied 0 artifacts from "build-scripts » release » create_installer_windows" build number 4769
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // node
[Pipeline] echo
22:35:58  Execution error: Failed to copy artifacts from build-scripts/release/create_installer_windows with filter: wix/ReleaseDir/*

karianna · 2020-06-16T11:53:42Z

Is that because of permissions or something else though...

douph1 · 2020-06-17T06:49:51Z

I have see lot of this error "Failed to copy artifacts" on internet with a stacktrace .. I don't know how but did you think we can print stacktrace together with the error message ?

M-Davies · 2020-06-19T09:10:46Z

@douph1 It doesn't look like it is printing the full trace 😭
https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk14u/job/jdk14u-windows-x64-openj9/116/console

08:18:25  Scheduling project: build-scripts » release » create_installer_windows
08:18:33  Starting building: build-scripts » release » create_installer_windows #4896
[Pipeline] copyArtifacts
08:24:18  Copied 0 artifacts from "build-scripts » release » create_installer_windows" build number 4896
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // node
[Pipeline] echo
08:24:18  Execution error: hudson.AbortException: Failed to copy artifacts from build-scripts/release/create_installer_windows with filter: wix/ReleaseDir/*

douph1 · 2020-06-19T09:16:11Z

I'm not a groovy export, I have just seen this syntax in the script using ${e} and I don't have made my homeworks :(
Maybe context.println "Execution error: " + e.printStackTrace()
is better ?

M-Davies · 2020-06-19T09:18:02Z

It's worth a shot 🤷

douph1 · 2020-06-19T09:19:09Z

wait
see https://issues.apache.org/jira/browse/GROOVY-3947
https://issues.jenkins-ci.org/browse/JENKINS-44808

System.err of the Jenkins JVM is not the same as the build log.

Pipeline scripts by default run in a sandbox.

but fails in a Jenkinsfile with Scripts not permitted to use method java.lang.Throwable getStackTrace

We must first know if

this to use this "unsecure" function to work in a jenkinsfile script or pipeline dsl library,

to help debug/understand #1834

* try re-throw exception to see full stacktrace to help debug/understand #1834 * fix indent

douph1 · 2020-06-22T11:48:14Z

it will be harder after next jenkins update to see stactrace for non-administrator :

https://www.jenkins.io/changelog-stable/
Suppress error stack traces for non-administrator users as core capability. (issue 60410)
https://issues.jenkins-ci.org/browse/JENKINS-60410
Hopefully, this is probably not the job stacktrace
Internal stack traces exposed to users

M-Davies · 2020-06-24T09:24:07Z

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x64-openj9/649/console

05:13:33  Copied 0 artifacts from "build-scripts » release » create_installer_windows" build number 5075
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // node
[Pipeline] echo
05:13:33  Execution error: hudson.AbortException: Failed to copy artifacts from build-scripts/release/create_installer_windows with filter: wix/ReleaseDir/*
[Pipeline] }
[Pipeline] // timeout
[Pipeline] }
[Pipeline] // timestamps
[Pipeline] End of Pipeline
ERROR: Failed to copy artifacts from build-scripts/release/create_installer_windows with filter: wix/ReleaseDir/*

Still no stacktrace unfortunately. Could we perhaps roll it back and just do printstacktrace and get admin permission to do so?

To debug adoptium#1834

To debug #1834

M-Davies · 2020-06-30T08:31:40Z

Renamed to make it more appropriate as this no longer a question

M-Davies · 2020-07-08T09:17:53Z

I suspect @andrew-m-leonard fixed this when he increased the job retention as I haven't seen this for a while now. I'll close this but we can always reopen if it reappears

douph1 assigned M-Davies Jun 8, 2020

douph1 added the question Issues that are queries about the code base or potential problems that have been spotted label Jun 8, 2020

M-Davies added the installer Issues that relate to our installer jobs or installer repo label Jun 8, 2020

karianna added this to TODO in temurin-build via automation Jun 8, 2020

karianna added this to the June 2020 milestone Jun 8, 2020

karianna moved this from TODO to In Progress in temurin-build Jun 8, 2020

M-Davies closed this as completed Jun 10, 2020

temurin-build automation moved this from In Progress to Done Jun 10, 2020

M-Davies reopened this Jun 11, 2020

temurin-build automation moved this from Done to In Progress Jun 11, 2020

M-Davies mentioned this issue Jun 11, 2020

Failed to copy artifacts from build-scripts/release/create_installer_windows adoptium/infrastructure#1384

Closed

M-Davies mentioned this issue Jun 11, 2020

Remove wix from installer filter #1856

Merged

M-Davies mentioned this issue Jun 11, 2020

Failed to copy artifacts - build-azure-win2012r2-x64-2 - jdk14u-windows-x64-openj9 #1858

Closed

douph1 mentioned this issue Jun 11, 2020

revert to last good copyArtifact filter #1862

Merged

M-Davies added bug Issues that are problems in the code as reported by the community and removed question Issues that are queries about the code base or potential problems that have been spotted labels Jun 11, 2020

douph1 mentioned this issue Jun 17, 2020

print full stacktrace instead just getMessage #1896

Merged

douph1 added a commit that referenced this issue Jun 19, 2020

try re-throw exception to see full stacktrace

c9ab463

to help debug/understand #1834

douph1 mentioned this issue Jun 19, 2020

try re-throw exception to see full stacktrace #1917

Merged

karianna pushed a commit that referenced this issue Jun 20, 2020

try re-throw exception to see full stacktrace (#1917)

e36a58c

* try re-throw exception to see full stacktrace to help debug/understand #1834 * fix indent

M-Davies assigned douph1 Jun 22, 2020

M-Davies pushed a commit to M-Davies/openjdk-build that referenced this issue Jun 24, 2020

Dump stack trace on build failure

55f5d86

To debug adoptium#1834

M-Davies mentioned this issue Jun 24, 2020

Dump stack trace on build failure #1924

Merged

karianna pushed a commit that referenced this issue Jun 24, 2020

Dump stack trace on build failure (#1924)

774ece7

To debug #1834

This was referenced Jun 25, 2020

Print the error and stacktrace together #1932

Merged

build failure : Can not access tar.gz. adoptium/infrastructure#1412

Closed

douph1 mentioned this issue Jun 25, 2020

Use jenkins utility function to print stack trace : printThrowable(e) #1934

Merged

This was referenced Jun 26, 2020

Nightly Build&Test Triage Report #1634

Closed

file permissions Issue - windows #1878

Closed

douph1 mentioned this issue Jun 30, 2020

Fix #1934 #1942

Closed

M-Davies changed the title ~~question about copy artifacts filter spec fix #1830~~ Failed to copy artifacts filter spec fix #1830 Jun 30, 2020

douph1 added a commit that referenced this issue Jun 30, 2020

print stacktrace to job console #1834

cc50048

karianna pushed a commit that referenced this issue Jun 30, 2020

print stacktrace to job console #1834 (#1943)

8ef7d76

karianna modified the milestones: June 2020, July 2020 Jul 1, 2020

M-Davies closed this as completed Jul 8, 2020

temurin-build automation moved this from In Progress to Done Jul 8, 2020

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Failed to copy artifacts filter spec fix #1830 #1834

Failed to copy artifacts filter spec fix #1830 #1834

douph1 commented Jun 8, 2020

douph1 commented Jun 8, 2020

M-Davies commented Jun 9, 2020

M-Davies commented Jun 10, 2020

M-Davies commented Jun 11, 2020 •

edited

M-Davies commented Jun 11, 2020

karianna commented Jun 11, 2020

M-Davies commented Jun 11, 2020

M-Davies commented Jun 16, 2020 •

edited

karianna commented Jun 16, 2020

douph1 commented Jun 17, 2020

M-Davies commented Jun 19, 2020 •

edited

douph1 commented Jun 19, 2020

M-Davies commented Jun 19, 2020

douph1 commented Jun 19, 2020 •

edited

douph1 commented Jun 22, 2020 •

edited

M-Davies commented Jun 24, 2020

M-Davies commented Jun 30, 2020

M-Davies commented Jul 8, 2020 •

edited

Failed to copy artifacts filter spec fix #1830 #1834

Failed to copy artifacts filter spec fix #1830 #1834

Comments

douph1 commented Jun 8, 2020

douph1 commented Jun 8, 2020

M-Davies commented Jun 9, 2020

M-Davies commented Jun 10, 2020

M-Davies commented Jun 11, 2020 • edited

M-Davies commented Jun 11, 2020

karianna commented Jun 11, 2020

M-Davies commented Jun 11, 2020

M-Davies commented Jun 16, 2020 • edited

karianna commented Jun 16, 2020

douph1 commented Jun 17, 2020

M-Davies commented Jun 19, 2020 • edited

douph1 commented Jun 19, 2020

M-Davies commented Jun 19, 2020

douph1 commented Jun 19, 2020 • edited

douph1 commented Jun 22, 2020 • edited

M-Davies commented Jun 24, 2020

M-Davies commented Jun 30, 2020

M-Davies commented Jul 8, 2020 • edited

M-Davies commented Jun 11, 2020 •

edited

M-Davies commented Jun 16, 2020 •

edited

M-Davies commented Jun 19, 2020 •

edited

douph1 commented Jun 19, 2020 •

edited

douph1 commented Jun 22, 2020 •

edited

M-Davies commented Jul 8, 2020 •

edited