Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test-packet-ubuntu1604-x64-1 and test-packet-ubuntu2004-x64-2: Cannot delete workspace #2597

Closed
llxia opened this issue Jun 9, 2022 · 12 comments

Comments

@llxia
Copy link

llxia commented Jun 9, 2022

Running on [test-packet-ubuntu1604-x64-1](https://ci.adoptopenjdk.net/computer/test-packet-ubuntu1604-x64-1/) in /home/jenkins/workspace/Grinder
[Pipeline] {
[Pipeline] timeout
Timeout set to expire in 1 hr 0 min
[Pipeline] {
[Pipeline] cleanWs
[WS-CLEANUP] Deleting project workspace...
[WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
ERROR: Cannot delete workspace :Unable to delete '/home/jenkins/workspace/Grinder/jvmtest/perf/framework-benchmarks/results/20220609083424/benchmark.log'. Tried 3 times (of a maximum of 3) waiting 0.1 sec between attempts.
[Pipeline] }
[Pipeline] // timeout
[Pipeline] echo
Exception: hudson.AbortException: Cannot delete workspace: Unable to delete '/home/jenkins/workspace/Grinder/jvmtest/perf/framework-benchmarks/results/20220609083424/benchmark.log'. Tried 3 times (of a maximum of 3) waiting 0.1 sec between attempts.
@llxia
Copy link
Author

llxia commented Jun 9, 2022

Same issue on https://ci.adoptopenjdk.net/computer/test-packet-ubuntu2004-x64-2/:
https://ci.adoptopenjdk.net/view/Test_grinder/job/Grinder/4964/console

Running on [test-packet-ubuntu2004-x64-2](https://ci.adoptopenjdk.net/computer/test-packet-ubuntu2004-x64-2/) in /home/jenkins/workspace/Grinder
[Pipeline] {
[Pipeline] timeout
Timeout set to expire in 1 hr 0 min
[Pipeline] {
[Pipeline] cleanWs
[WS-CLEANUP] Deleting project workspace...
[WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
ERROR: Cannot delete workspace :Unable to delete '/home/jenkins/workspace/Grinder/jvmtest/perf/framework-benchmarks/results/20220609082844/test_metadata.json'. Tried 3 times (of a maximum of 3) waiting 0.1 sec between attempts.
[Pipeline] }
[Pipeline] // timeout
[Pipeline] echo
Exception: hudson.AbortException: Cannot delete workspace: Unable to delete '/home/jenkins/workspace/Grinder/jvmtest/perf/framework-benchmarks/results/20220609082844/test_metadata.json'. Tried 3 times (of a maximum of 3) waiting 0.1 sec between attempts.

@llxia
Copy link
Author

llxia commented Jun 9, 2022

Could we mark these machines offline for now?

@smlambert
Copy link
Contributor

I have marked -2 offline with a link to this issue, -1 is offline with this message:

This agent is offline because Jenkins failed to launch the agent process on it.

@sxa sxa changed the title test-packet-ubuntu1604-x64-1 Cannot delete workspace test-packet-ubuntu1604-x64-1 and test-packet-ubuntu2004-x64-2: Cannot delete workspace Jun 9, 2022
@sxa
Copy link
Member

sxa commented Jun 13, 2022

@smlambert @llxia The results directory on those machines has been created as root - do you knowhow that has happened? Is it doing something in docker? In which case we need to look at the security of this...

drwxrwxr-x  3 jenkins jenkins 4096 Jun  9 08:31 deployment
drwxrwxr-x 40 jenkins jenkins 4096 Jun  9 08:31 frameworks
drwxr-xr-x  3 root    root    4096 Jun  9 08:34 results
-rwxrwxr-x  1 jenkins jenkins 3007 Jun  9 08:31 tfb
-rw-rw-r--  1 jenkins jenkins    0 Jun  9 08:32 tmpt
drwxrwxr-x 10 jenkins jenkins 4096 Jun  9 08:34 toolset

@smlambert
Copy link
Contributor

I think this may have occurred as part of @joeyleeeeeee97 testing this PR for the addition of a new test (and yes, its container-based).

@joeyleeeeeee97
Copy link
Contributor

joeyleeeeeee97 commented Jun 14, 2022

@sxa
FrameworkBenchmarks is running test with root in docker..
Maybe I need to reset the file mode to get it removable?

@llxia
Copy link
Author

llxia commented Jun 15, 2022

Can we mark https://ci.adoptopenjdk.net/computer/test-packet-ubuntu1604-x64-1/ offline? It is back online now and jobs that land on it will fail.
https://ci.adoptopenjdk.net/view/Test_grinder/job/Grinder/5002/

@smlambert
Copy link
Contributor

Marked -1 offline with a link to this issue.

@sxa
Copy link
Member

sxa commented Jul 12, 2022

build-alibaba-win2012r2-x64-2

@sophia-guo Can you put that in a separate issue please(possibly #2209 if you want to re-use one) as the cause on Linux vs Windows is unlikely to be the same. Thanks.

@sxa
Copy link
Member

sxa commented Jul 15, 2022

NOTE: These machines are likely to be replaced soon as part of #2666

@sxa sxa self-assigned this Jul 15, 2022
@sxa sxa added this to the 2022-07 (July) milestone Jul 15, 2022
@sxa
Copy link
Member

sxa commented Jan 12, 2023

Closing as they have been decomissioned

@sxa sxa closed this as completed Jan 12, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
No open projects
Development

No branches or pull requests

6 participants