Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue 3567: Upgrade rocksdb version to avoid checksum mismatch error #3568

Closed

Conversation

zhaohaidao
Copy link
Contributor

@zhaohaidao zhaohaidao commented Oct 24, 2022

Motivation

Rocksdb instance throws Checksum Mismatch exception frequently in high workload(2000MB/s with 3 bookies and 3 replica) with directio mode.
I checked the release history of rocksdb and found that checksum mismatch bug maybe fixed after 7.4.0. The fix is followed

  • Fixed a bug in WriteBatchInternal::Append() where WAL termination point in write batch was not considered and the function appends an incorrect number of checksums.

Changes

Upgrade rocksdb version to 7.4.5 to avoid checksum mismatch error
After rocksdb upgraded to 7.4.5. Checksum mismatch error no longer appears

Master Issue: #3567

@dlg99
Copy link
Contributor

dlg99 commented Oct 24, 2022

lgtm.
Please update license files (see #3026 as example)

Copy link
Contributor

@hangc0276 hangc0276 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It upgrades the major version of the RocksDB(7.x), and I'm not sure whether it can compatible with the current RocksDB version (6.x). Does RocksDB 6.x contains this fix?

@hangc0276
Copy link
Contributor

@zhaohaidao Would you please start a discussion in the dev mail list for upgrading RocksDB to 7.x?

@zhaohaidao
Copy link
Contributor Author

@zhaohaidao Would you please start a discussion in the dev mail list for upgrading RocksDB to 7.x?

Ok, I will take the time to launch the discussion in the near future, thank you for reminding
@hangc0276

@hangc0276
Copy link
Contributor

The RocksDB version has been upgraded to 7.9.2, close this PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants