Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PDS prepare upload remote data to shared storage #3131

Merged
merged 29 commits into from
Jun 13, 2024

Commits on May 14, 2024

  1. Configuration menu
    Copy the full SHA
    c98952d View commit details
    Browse the repository at this point in the history

Commits on May 15, 2024

  1. Configuration menu
    Copy the full SHA
    6e5f747 View commit details
    Browse the repository at this point in the history

Commits on May 16, 2024

  1. Configuration menu
    Copy the full SHA
    8b6c45a View commit details
    Browse the repository at this point in the history

Commits on May 21, 2024

  1. Configuration menu
    Copy the full SHA
    74f6c0c View commit details
    Browse the repository at this point in the history

Commits on May 22, 2024

  1. Configuration menu
    Copy the full SHA
    00a4ff3 View commit details
    Browse the repository at this point in the history

Commits on May 24, 2024

  1. Configuration menu
    Copy the full SHA
    e8ea8e6 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    4d2082f View commit details
    Browse the repository at this point in the history
  3. Added change requests #3026

    lorriborri committed May 24, 2024
    Configuration menu
    Copy the full SHA
    43a6c11 View commit details
    Browse the repository at this point in the history

Commits on May 27, 2024

  1. Added change requests #3026

    lorriborri committed May 27, 2024
    Configuration menu
    Copy the full SHA
    d2b7d1c View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    e1eb1e2 View commit details
    Browse the repository at this point in the history

Commits on May 28, 2024

  1. Configuration menu
    Copy the full SHA
    75ac56e View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    55187d0 View commit details
    Browse the repository at this point in the history

Commits on May 29, 2024

  1. Configuration menu
    Copy the full SHA
    51e2555 View commit details
    Browse the repository at this point in the history
  2. Added PDS_SORAGE environment variables to be adde to the envrionment …

    …when PDS prepare is called #3026
    lorriborri committed May 29, 2024
    Configuration menu
    Copy the full SHA
    26da4f6 View commit details
    Browse the repository at this point in the history

Commits on May 31, 2024

  1. Added integrationtest #3026

    lorriborri committed May 31, 2024
    Configuration menu
    Copy the full SHA
    6054e12 View commit details
    Browse the repository at this point in the history
  2. Added change requests #3026

    lorriborri committed May 31, 2024
    Configuration menu
    Copy the full SHA
    129e07c View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    86034e2 View commit details
    Browse the repository at this point in the history
  4. Removed unnecessary ENV #3026

    lorriborri committed May 31, 2024
    Configuration menu
    Copy the full SHA
    c0d27f6 View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2024

  1. Refactoring + changes #3026

    - validation now without inheritance by introducing input validation
      support class
    - renamed some classes - e.g. WrapperSkopeo -> SkopeoWrapper etc.
    - changed tests for validation
    - removed package prepare.prepare
    - moved parts which were used only internally by implementations
      to abstract base class + changed visibility to protected only
    - reduced amount of packages, technical parts like factory moved to
      semantic packages or to main prepare package if there are was
      no special semantic
    - refactored tests to make easier to read - e.g. same setup parts
      to beforeEach method etc.
    de-jcup committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    8561617 View commit details
    Browse the repository at this point in the history
  2. Reduced log output and speed up integration tests #3197, #3198

    - log outputs reduced /enhanced
    - integration test reconnection of executor configurations on local
      test restarts do now only load necessary data
    de-jcup committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    ba0f3ab View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    2dd0cb7 View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2024

  1. Refactoring and bugfixes #3026

    - renamed ToolWrapper to AbstractToolWrapper
    - fixed failure in javadoc of Scenario 22
    - renamed some parts inside skopeo preparation module
    - dropped getProcess() inside ProcessAdapter (avoid that anybody
      uses direct process access - all shall be done by adapter)
    - removed pepare wrapper environment variable class, was not used
      any more
    - extracted Git location converter and wrote tests
    - url conversion method now returns an URL instead of a string
    de-jcup committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    083b221 View commit details
    Browse the repository at this point in the history
  2. Skopeo call changes #3026

    - replaced process builder call for cleanup on skopeo with
      java file api variant (delete auth file)
    - skopeo now called with stdin input for password
    - introduced process builder factory + tests
    - process adapter supports now user input per stdin
    - added test for process adapter support (stdin)
    - moved logic for skopeo location conversion to own class
      (SkopeoLocationConverter) and wrote tests, afterwards
      implementation was changed
    de-jcup committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    6b535c4 View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2024

  1. Changed directory cleanup from process to plain java #3026

    - introduced DirectoryAndFileSupport, wrote tests
    - introduced AutoCleanupGitFilesFilter, wrote tests
    - updated GitWrapperTest
    - separated former git auto clean environment entry to
      KEY_PDS_PREPARE_MODULE_GIT_REMOVE_GIT_FILES_BEFORE_UPLOAD
      KEY_PDS_PREPARE_MODULE_GIT_CLONE_WITHOUT_GIT_HISTORY
    - changed environment entries for skopeo as well, everything from
      a module is now prefixed "pds.prepare.module." etc.
    de-jcup committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    63ce627 View commit details
    Browse the repository at this point in the history
  2. Changed git prepare module cleanup behavior and documentatino #3026

    - when git history is not wanted, the .git folder is now
      always removed
    - additional gitfiles are treated extra
    - pds config file in pds prepare solution has now the parameters
      inside as optional
    de-jcup committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    30e7e64 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    a4ac055 View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2024

  1. Review changes #3026

    - added PDS_WORKSPACE_AUTOCLEAN_DISABLED handling in deployment.yaml
      again
    de-jcup committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    87d2b9c View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2024

  1. Configuration menu
    Copy the full SHA
    2e87924 View commit details
    Browse the repository at this point in the history
  2. Review changes #3026

    - dropped unnecessary class
    - added missing licence header
    - small refactoring inside DirectoryAndFileSupport
    de-jcup committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    a1b1809 View commit details
    Browse the repository at this point in the history