Skip to content
This repository has been archived by the owner on Nov 30, 2022. It is now read-only.

int/athena: seems like cleanup doesn't happen #295

Open
milanaleksic opened this issue Mar 12, 2021 · 0 comments
Open

int/athena: seems like cleanup doesn't happen #295

milanaleksic opened this issue Mar 12, 2021 · 0 comments

Comments

@milanaleksic
Copy link
Contributor

In integration testing of Athena warehouse I have noticed we have rather large number of databases on our test cluster.

Perfect fix

Perfect solution would probably to figure out why this happens and try to avoid it.

Alternative: cleanup

We should probably clean this up with manual actions, but since we recently had similar issue with Redshift maybe we should tackle this differently. Some options:

  1. cron workflow that removes all databases that end up being used across our INT testing setup; OR
  2. clean up all databases older than X (for this we should probably add epoch time as suffix so we can reason about it)
@vijaykiran vijaykiran transferred this issue from sodadata/soda-core Mar 22, 2022
@vijaykiran vijaykiran transferred this issue from sodadata/soda-core Mar 22, 2022
@vijaykiran vijaykiran transferred this issue from sodadata/soda-core Mar 22, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

2 participants