Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use Badger's value log threshold of 1MB #7415

Merged
merged 3 commits into from Feb 9, 2021
Merged

Conversation

manishrjain
Copy link
Contributor

@manishrjain manishrjain commented Feb 9, 2021

The write amplification of using value log has been unpredictably high. With this change, we'd use 1MB as ValueThreshold to push as many things as possible into the LSM tree. Previously it was 1KB.


This change is Reviewable

@github-actions github-actions bot added the area/bulk-loader Issues related to bulk loading. label Feb 9, 2021
@manishrjain manishrjain merged commit 3d1a359 into master Feb 9, 2021
@manishrjain manishrjain deleted the mrjn/value-threshold branch February 9, 2021 22:32
danielmai pushed a commit that referenced this pull request Feb 10, 2021
The write amplification of using value log has been unpredictably high. With this change, we'd use 1MB as ValueThreshold to push as many things as possible into the LSM tree. Previously it was 1KB.
danielmai pushed a commit that referenced this pull request Feb 10, 2021
The write amplification of using value log has been unpredictably high. With this change, we'd use 1MB as ValueThreshold to push as many things as possible into the LSM tree. Previously it was 1KB.
danielmai pushed a commit that referenced this pull request Feb 23, 2021
The write amplification of using value log has been unpredictably high. With this change, we'd use 1MB as ValueThreshold to push as many things as possible into the LSM tree. Previously it was 1KB.
danielmai added a commit that referenced this pull request Mar 18, 2021
The write amplification of using value log has been unpredictably high. With this change, we'd use 1MB as ValueThreshold to push as many things as possible into the LSM tree. Previously it was 1KB.

Co-authored-by: Manish R Jain <manish@dgraph.io>
danielmai added a commit that referenced this pull request Mar 19, 2021
The write amplification of using value log has been unpredictably high. With this change, we'd use 1MB as ValueThreshold to push as many things as possible into the LSM tree. Previously it was 1KB.

Co-authored-by: Manish R Jain <manish@dgraph.io>
danielmai added a commit that referenced this pull request Mar 19, 2021
The write amplification of using value log has been unpredictably high. With this change, we'd use 1MB as ValueThreshold to push as many things as possible into the LSM tree. Previously it was 1KB.

Co-authored-by: Manish R Jain <manish@dgraph.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/bulk-loader Issues related to bulk loading.
Development

Successfully merging this pull request may close these issues.

None yet

1 participant