Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Delete old snapshots SEPTEMBER #5536

Closed
4 tasks
cnlucas opened this issue Aug 8, 2023 · 0 comments
Closed
4 tasks

Delete old snapshots SEPTEMBER #5536

cnlucas opened this issue Aug 8, 2023 · 0 comments
Assignees
Milestone

Comments

@cnlucas
Copy link
Member

cnlucas commented Aug 8, 2023

What we’re after

We have been running out of capacity in our S3 bucket. Until we figure out a long-term solution to this issue, we should clean out old snapshots manually every month.

Deleting old snapshot instructions are here.

Login to cloud.gov and make sure you're in prod space. You should tail the logs in another terminal window. Production logs are hard to tail and often don't return for API. You can GREP [ex: cf logs api | grep "display_snapshot_detail_case"] the logs for a specific task, but that may not return as well. If you want to check your work you should check the logs in Kibana.

You should delete the old snapshots for AO's and Current MUR's (cases) but don't need to delete arch MUR's. You can delete the prior month by updating these example commands:
cf run-task api --command "python cli.py delete_snapshot case_repo case_snapshot_202306*" -m 2G --name delete_snapshot
cf run-task api --command "python cli.py delete_snapshot ao_repo ao_snapshot_202306*" -m 2G --name delete_snapshot_ao

You should use the display_snapshots and display_snapshots_detail commands and you can also run cf tasks api to see if the commands executed successfully.

Related ticket(s)

(Include the tickets that either came before, after, or are happening in tandem with this new ticket)

  • Long-term solution ticket

Action item(s)

(These are the smaller tasks that should happen in order to complete this work)

  • Delete the old snapshots
  • Create a ticket for next month if the solution hasn't been found yet

Completion criteria

  • Old snapshots are deleted
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants