-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Why these changes are being introduced: We had previously skipped deleted records during command generation, but we're now ready to include them so they can be handled by other applications in the pipeline. How this addresses that need: * Adds deleted record commands to the generate_load_commands function. * Logs an error if deleted record transform output files are found while generating load commands, as this indicates there is an issue with the full export from source. * Removes deleted record command placeholder from the generate_transform_commands function, as the input command to transmogrifier is identical for all records. * Updates the helpers step_output_filename function to generate the correct filename for deleted records. * Updates relevant tests. Relevant ticket(s): * https://mitlibraries.atlassian.net/browse/TIMX-142
- Loading branch information
Showing
5 changed files
with
98 additions
and
15 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters