-
Notifications
You must be signed in to change notification settings - Fork 63
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Enable PDS prepare to upload to shared storage #3026
Comments
lorriborri
added a commit
that referenced
this issue
May 14, 2024
4 tasks
lorriborri
added a commit
that referenced
this issue
May 15, 2024
lorriborri
added a commit
that referenced
this issue
May 21, 2024
lorriborri
added a commit
that referenced
this issue
May 22, 2024
lorriborri
added a commit
that referenced
this issue
May 24, 2024
lorriborri
added a commit
that referenced
this issue
May 24, 2024
lorriborri
added a commit
that referenced
this issue
May 24, 2024
lorriborri
added a commit
that referenced
this issue
May 24, 2024
lorriborri
added a commit
that referenced
this issue
May 27, 2024
lorriborri
added a commit
that referenced
this issue
May 27, 2024
lorriborri
added a commit
that referenced
this issue
May 28, 2024
lorriborri
added a commit
that referenced
this issue
May 28, 2024
lorriborri
added a commit
that referenced
this issue
May 29, 2024
lorriborri
added a commit
that referenced
this issue
May 31, 2024
lorriborri
added a commit
that referenced
this issue
May 31, 2024
lorriborri
added a commit
that referenced
this issue
May 31, 2024
de-jcup
added a commit
that referenced
this issue
Jun 3, 2024
- validation now without inheritance by introducing input validation support class - renamed some classes - e.g. WrapperSkopeo -> SkopeoWrapper - changed tests for validation
de-jcup
added a commit
that referenced
this issue
Jun 6, 2024
- validation now without inheritance by introducing input validation support class - renamed some classes - e.g. WrapperSkopeo -> SkopeoWrapper etc. - changed tests for validation - removed package prepare.prepare - moved parts which were used only internally by implementations to abstract base class + changed visibility to protected only - reduced amount of packages, technical parts like factory moved to semantic packages or to main prepare package if there are was no special semantic
de-jcup
added a commit
that referenced
this issue
Jun 7, 2024
- validation now without inheritance by introducing input validation support class - renamed some classes - e.g. WrapperSkopeo -> SkopeoWrapper etc. - changed tests for validation - removed package prepare.prepare - moved parts which were used only internally by implementations to abstract base class + changed visibility to protected only - reduced amount of packages, technical parts like factory moved to semantic packages or to main prepare package if there are was no special semantic - refactored tests to make easier to read - e.g. same setup parts to beforeEach method etc.
de-jcup
added a commit
that referenced
this issue
Jun 7, 2024
de-jcup
added a commit
that referenced
this issue
Jun 7, 2024
de-jcup
added a commit
that referenced
this issue
Jun 10, 2024
- renamed ToolWrapper to AbstractToolWrapper - fixed failure in javadoc of Scenario 22 - renamed some parts inside skopeo preparation module - dropped getProcess() inside ProcessAdapter (avoid that anybody uses direct process access - all shall be done by adapter) - removed pepare wrapper environment variable class, was not used any more - extracted Git location converter and wrote tests - url conversion method now returns an URL instead of a string
de-jcup
added a commit
that referenced
this issue
Jun 10, 2024
- replaced process builder call for cleanup on skopeo with java file api variant (delete auth file) - skopeo now called with stdin input for password - introduced process builder factory + tests - process adapter supports now user input per stdin - added test for process adapter support (stdin) - moved logic for skopeo location conversion to own class (SkopeoLocationConverter) and wrote tests, afterwards implementation was changed
de-jcup
added a commit
that referenced
this issue
Jun 10, 2024
- introduced DirectoryAndFileSupport, wrote tests - introduced AutoCleanupGitFilesFilter, wrote tests - updated GitWrapperTest - separated former git auto clean environment entry to KEY_PDS_PREPARE_MODULE_GIT_REMOVE_GIT_FILES_BEFORE_UPLOAD KEY_PDS_PREPARE_MODULE_GIT_CLONE_WITHOUT_GIT_HISTORY - changed environment entries for skopeo as well, everything from a module is now prefixed "pds.prepare.module." etc.
de-jcup
added a commit
that referenced
this issue
Jun 10, 2024
- introduced DirectoryAndFileSupport, wrote tests - introduced AutoCleanupGitFilesFilter, wrote tests - updated GitWrapperTest - separated former git auto clean environment entry to KEY_PDS_PREPARE_MODULE_GIT_REMOVE_GIT_FILES_BEFORE_UPLOAD KEY_PDS_PREPARE_MODULE_GIT_CLONE_WITHOUT_GIT_HISTORY - changed environment entries for skopeo as well, everything from a module is now prefixed "pds.prepare.module." etc.
de-jcup
added a commit
that referenced
this issue
Jun 11, 2024
- introduced DirectoryAndFileSupport, wrote tests - introduced AutoCleanupGitFilesFilter, wrote tests - updated GitWrapperTest - separated former git auto clean environment entry to KEY_PDS_PREPARE_MODULE_GIT_REMOVE_GIT_FILES_BEFORE_UPLOAD KEY_PDS_PREPARE_MODULE_GIT_CLONE_WITHOUT_GIT_HISTORY - changed environment entries for skopeo as well, everything from a module is now prefixed "pds.prepare.module." etc.
de-jcup
added a commit
that referenced
this issue
Jun 11, 2024
- when git history is not wanted, the .git folder is now always removed - additional gitfiles are treated extra - pds config file in pds prepare solution has now the parameters inside as optional
de-jcup
added a commit
that referenced
this issue
Jun 13, 2024
- added PDS_WORKSPACE_AUTOCLEAN_DISABLED handling in deployment.yaml again
de-jcup
added a commit
that referenced
this issue
Jun 13, 2024
- dropped unnecessary class - added missing licence header - small refactoring inside DirectoryAndFileSupport
de-jcup
added a commit
that referenced
this issue
Jun 13, 2024
* Integrated upload classes and archive support for prepare #3026 * Moved LogSanitizer in pds-commons-core #3026 * Fixed storage problem and enhanced integration tests #3026 - fixed failure in javadoc of Scenario 22 * Skopeo call changes #3026 - replaced process builder call for cleanup on skopeo with java file api variant (delete auth file) - skopeo now called with stdin input for password - introduced process builder factory + tests - process adapter supports now user input per stdin - added test for process adapter support (stdin) - moved logic for skopeo location conversion to own class (SkopeoLocationConverter) and wrote tests, afterwards implementation was changed * Changed directory cleanup from process to plain java #3026 - introduced DirectoryAndFileSupport, wrote tests - introduced AutoCleanupGitFilesFilter, wrote tests - updated GitWrapperTest - separated former git auto clean environment entry to KEY_PDS_PREPARE_MODULE_GIT_REMOVE_GIT_FILES_BEFORE_UPLOAD KEY_PDS_PREPARE_MODULE_GIT_CLONE_WITHOUT_GIT_HISTORY - changed environment entries for skopeo as well, everything from a module is now prefixed "pds.prepare.module." etc. * Changed git prepare module cleanup behavior and documentatino #3026 - when git history is not wanted, the .git folder is now always removed - additional gitfiles are treated extra - pds config file in pds prepare solution has now the parameters inside as optional --------- Co-authored-by: Albert Tregnaghi <albert.tregnaghi@mercedes-benz.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Situation
The PDS prepare should be able to load prepared data into the shared storage so that it is available for further scans.
Wanted
When data has been successfully prepared, the PDS prepare should upload it to the shared storage.
Solution
Introduce environment variable PDS_PREPARED_FOLDER, the PDS should upload all data in this folder to the storage
The text was updated successfully, but these errors were encountered: