Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Purge duplicate files from 2021-02-02_15-xx #159

Closed
jeanpaulrsoucy opened this issue May 5, 2021 · 0 comments
Closed

Purge duplicate files from 2021-02-02_15-xx #159

jeanpaulrsoucy opened this issue May 5, 2021 · 0 comments
Labels
backend-storage Issues related to how files are stored and made accessible bug Something isn't working data fix or update Update or fix for an existing data

Comments

@jeanpaulrsoucy
Copy link
Member

Due to an error, the archival tool ran mid-day on 2021-02-02 in addition to the usual 10 pm ET nightly update. Thus, there are duplicated files for all the datasets that were in datasets.json at that time. Careful use of the AWS CLI should be able to purge/move these unnecessary files.

See also #115.

@jeanpaulrsoucy jeanpaulrsoucy added backend-storage Issues related to how files are stored and made accessible bug Something isn't working data fix or update Update or fix for an existing data labels May 5, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backend-storage Issues related to how files are stored and made accessible bug Something isn't working data fix or update Update or fix for an existing data
Projects
None yet
Development

No branches or pull requests

1 participant