Skip to content
This repository has been archived by the owner on Aug 11, 2023. It is now read-only.

Feat: Copy files removed from target in WatchFolder flow #30

Open
wants to merge 2 commits into
base: release31
Choose a base branch
from

Conversation

ianshade
Copy link
Contributor

This PR adds an optional cron job feature to WatchFolder flow, that periodically checks for files that are missing on the target storage but are still present on the source storage, and issues a workflow to copy them.
Option can be enabled per flow, in its settings.

@sparkpunkd
Copy link
Contributor

This should be 2 PRs.

  1. Commit e2e0bc0 is appropriate as a fix to release 22.1.
  2. The cron job feature should target a later release in case this causes issues. This requires release testing at NRK.

@sparkpunkd sparkpunkd changed the base branch from release22.2 to release30 February 18, 2021 09:17
@sparkpunkd sparkpunkd changed the base branch from release30 to release22.2 February 18, 2021 09:22
@sparkpunkd sparkpunkd removed their assignment Feb 18, 2021
@sparkpunkd sparkpunkd changed the base branch from release22.2 to release31 February 18, 2021 09:31
@sparkpunkd sparkpunkd self-requested a review February 18, 2021 09:33
Copy link
Contributor

@sparkpunkd sparkpunkd left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This PR has been hanging around for a while. The request to split into 2 was never actionned. And the fix to change "targetID" to "destinationId" has been in for 5 months now.

If this feature still required? If so, I have retargetted at Release 31. The world has moved on the the checkAndEmitCopyFunction has been reworked. This PR contains what appears to be a copy and paste of that function from the expectedItemsGenerator ... a bad code smell. So although this PR would merge into R31, I would like to see some consideration of code sharing between the expectedItemsGenerator and the watchFolderGenerator.

If no longer required, please close the PR.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants