Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add the ability to delete rows from occ_uuid #293

Closed
ansell opened this issue Nov 14, 2018 · 0 comments
Closed

Add the ability to delete rows from occ_uuid #293

ansell opened this issue Nov 14, 2018 · 0 comments
Assignees

Comments

@ansell
Copy link
Contributor

ansell commented Nov 14, 2018

The intentional architecture choice to hide rowkeys from every level of the system after the initial load has hidden failures in the way the row keys are computed. There needs to be a way to delete these to maintain the current list of uuid to rowkey mappings and verify that biocache-store is not still broken.

This particularly relates to #282 but there are also other operations that are virtually impossible to debug at this point due to the obfuscation layer that occ_uuid adds.

@ansell ansell self-assigned this Nov 14, 2018
ansell added a commit to ansell/biocache-store that referenced this issue Nov 16, 2018
…rom occ_uuid to clean out bad data

Signed-off-by: Peter Ansell <p_ansell@yahoo.com>
ansell added a commit to ansell/biocache-store that referenced this issue Nov 16, 2018
Defaults to false, but set to true in FileDelete for testing. Needs to be exposed as a cli option

Signed-off-by: Peter Ansell <p_ansell@yahoo.com>
ansell added a commit to ansell/biocache-store that referenced this issue Nov 20, 2018
…D and rowkeys in biocache-store

Fix AtlasOfLivingAustralia#296 : Make dellog primary key include id so it is reasonably unique

Previous key was the current timestamp to second resolution, causing loss of records from the dellog column family when hundreds or thousands of records are deleted each second, as cassandra and the deletion code is capable of.

issue AtlasOfLivingAustralia#293 : Add initial support for deleting from occ_uuid to clean out bad data

Signed-off-by: Peter Ansell <p_ansell@yahoo.com>
@ansell ansell closed this as completed Nov 20, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant