Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve Jenkins java-manta-it job and Integration-Tests to clear residual data #502

Open
indianwhocodes opened this issue Mar 14, 2019 · 2 comments

Comments

@indianwhocodes
Copy link
Contributor

indianwhocodes commented Mar 14, 2019

  • Create an optional system parameter that is used for all test run directories (eg ~~/stor/java-manta-integration-tests/uuid) . This would allow us to create that dir name in the jenkins job before execution and then to delete the directory, post a successful/unsuccessful execution.

  • Figure out a way to clean up job history and multipart upload history within the integration tests and if any files are being left over in Manta after a successful/unsucessful test run.

@indianwhocodes
Copy link
Contributor Author

indianwhocodes commented Jul 11, 2019

#544 once merged will resolve this issue.

@cburroughs
Copy link
Contributor

This is the current "scrub" job

echo "Scrubbing jobs for user $USER_TO_SCRUB"
mls /$USER_TO_SCRUB/jobs | xargs -n1 -P4 -I{} bash -c "mrm -r /$USER_TO_SCRUB/jobs/{} && echo deleted /$USER_TO_SCRUB/jobs/{}"

echo "Scrubbing jobs-based MPUs for user $USER_TO_SCRUB"
mrm -r /$USER_TO_SCRUB/stor/.multipart-6439b444-9041-11e6-9be2-9f622f483d01/ || true

echo "Scrubbing default integration test folder for user $USER_TO_SCRUB"
mrm -r /$USER_TO_SCRUB/stor/java-manta-integration-tests/

See also MANTA-2954

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants