-
Notifications
You must be signed in to change notification settings - Fork 903
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[ledger storage] DbLedgerStorage should do periodical flush #1843
Conversation
*Motivation* DbLedgerStorage doesn't drive checkpoint itself. so currently DbLedgerStorage flush only happens either when write-cache is full or entry log file rotated. The correctness is still maintained. However the behavior is different from original yahoo behavior. *Changes* Revert the behavior back to original periodical flush
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Change LGTM. Maybe we could also have a method in the LedgerStorage
interface that each implementation can use to declare if it wants to have the sync thread to be scheduled or not.
was thinking about doing that in a subsequent change. because this change is going to all 3 branches, so better to keep the change simple, so I don't encounter any issue when cherry-pick it to branches. |
Sure, let's do that in master only. |
run integration tests |
Descriptions of the changes in this PR: *Motivation* DbLedgerStorage doesn't drive checkpoint itself. so currently DbLedgerStorage flush only happens either when write-cache is full or entry log file rotated. The correctness is still maintained. However the behavior is different from original yahoo behavior. *Changes* Revert the behavior back to original periodical flush Reviewers: Matteo Merli <mmerli@apache.org>, Jia Zhai <None> This closes #1843 from sijie/dbledgerstorage_sync (cherry picked from commit d7fffac) Signed-off-by: Sijie Guo <sijie@apache.org>
Descriptions of the changes in this PR: *Motivation* DbLedgerStorage doesn't drive checkpoint itself. so currently DbLedgerStorage flush only happens either when write-cache is full or entry log file rotated. The correctness is still maintained. However the behavior is different from original yahoo behavior. *Changes* Revert the behavior back to original periodical flush Reviewers: Matteo Merli <mmerli@apache.org>, Jia Zhai <None> This closes #1843 from sijie/dbledgerstorage_sync (cherry picked from commit d7fffac) Signed-off-by: Sijie Guo <sijie@apache.org>
Descriptions of the changes in this PR:
Motivation
DbLedgerStorage doesn't drive checkpoint itself. so currently DbLedgerStorage flush only
happens either when write-cache is full or entry log file rotated. The correctness is still
maintained. However the behavior is different from original yahoo behavior.
Changes
Revert the behavior back to original periodical flush