Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added cronjob to schedule regular backup compaction #197

Merged
merged 1 commit into from
Jul 15, 2021

Conversation

aaronfern
Copy link
Contributor

@aaronfern aaronfern commented Jun 25, 2021

How to categorize this PR?

/area backup
/kind enhancement

What this PR does / why we need it:
This PR enhances etcd druid to allow it to create a cronjob to schedule regular backup compactions to limit the number of incremental snapshots needed at any point in time for restoration and ultimately improve etcd restoration performance.
Cronjob is created based on a configurable etcd spec field compactionSchedule

Which issue(s) this PR fixes:
Fixes #191

Special notes for your reviewer:

Release note:

Added support for `etcd druid` to regularly schedule backup compactions via configurable etcd spec `spec.backup.compactionSchedule`

@aaronfern aaronfern requested a review from a team as a code owner June 25, 2021 15:55
@gardener-robot gardener-robot added area/backup Backup related kind/enhancement Enhancement, improvement, extension needs/review Needs review size/xl Size of pull request is huge (see gardener-robot robot/bots/size.py) needs/second-opinion Needs second review by someone else labels Jun 25, 2021
@gardener-robot-ci-3
Copy link
Contributor

Thank you @aaronfern for your contribution. Before I can start building your PR, a member of the organization must set the required label(s) {'reviewed/ok-to-test'}. Once started, you can check the build status in the PR checks section below.

@aaronfern aaronfern force-pushed the cronjob branch 2 times, most recently from 3569915 to 6167723 Compare July 2, 2021 08:48
Copy link
Collaborator

@amshuman-kr amshuman-kr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the changes @aaronfern! Overall looks very good. Just some minor suggestions below.

api/v1alpha1/etcd_types.go Outdated Show resolved Hide resolved
charts/etcd/templates/etcd-compaction-cronjob.yaml Outdated Show resolved Hide resolved
controllers/etcd_controller.go Outdated Show resolved Hide resolved
controllers/etcd_controller.go Outdated Show resolved Hide resolved
controllers/etcd_controller.go Outdated Show resolved Hide resolved
controllers/etcd_controller.go Outdated Show resolved Hide resolved
controllers/etcd_controller_test.go Outdated Show resolved Hide resolved
@gardener-robot gardener-robot added the needs/changes Needs (more) changes label Jul 5, 2021
@amshuman-kr
Copy link
Collaborator

/invite @abdasgupta @shreyas-s-rao @ishan16696

Copy link
Contributor

@abdasgupta abdasgupta left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for the PR. Here are some feedback.

controllers/controller_ref_manager.go Outdated Show resolved Hide resolved
controllers/etcd_controller.go Show resolved Hide resolved
controllers/etcd_controller.go Show resolved Hide resolved
controllers/etcd_controller_test.go Outdated Show resolved Hide resolved
controllers/etcd_controller.go Show resolved Hide resolved
@gardener-robot
Copy link

@aaronfern You have pull request review with status CHANGES_REQUESTED, please check

@gardener-robot
Copy link

@shreyas-s-rao, @ishan16696 You have pull request review open invite, please check

Copy link
Collaborator

@amshuman-kr amshuman-kr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm My comments are addressed. @abdasgupta can you please check if this looks fine for you too?

@gardener-robot gardener-robot added reviewed/lgtm Has approval for merging and removed needs/changes Needs (more) changes needs/review Needs review needs/second-opinion Needs second review by someone else labels Jul 15, 2021
Copy link
Contributor

@abdasgupta abdasgupta left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@abdasgupta abdasgupta merged commit 787692e into gardener:master Jul 15, 2021
@aaronfern aaronfern deleted the cronjob branch August 12, 2022 13:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/backup Backup related kind/enhancement Enhancement, improvement, extension reviewed/lgtm Has approval for merging size/xl Size of pull request is huge (see gardener-robot robot/bots/size.py)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Feature] Schedule regular backup compaction
5 participants