Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(db): Fix write stalls in RocksDB #250

Merged
merged 2 commits into from
Oct 18, 2023

Conversation

slowli
Copy link
Contributor

@slowli slowli commented Oct 18, 2023

What ❔

Fixes write stalls in RocksDB by configuring related DB options and retrying batch writes on stall.

Why ❔

Currently, write stalls lead to panics and maybe even to crash loops.

Checklist

  • PR title corresponds to the body of PR (we generate changelog entries from PRs).
  • Tests for the changes have been added / updated.
  • Documentation comments have been added / updated. not applicable
  • Code has been formatted via zk fmt and zk lint.

@codecov
Copy link

codecov bot commented Oct 18, 2023

Codecov Report

Attention: 20 lines in your changes are missing coverage. Please review.

Comparison is base (e3fb489) 33.05% compared to head (73935c8) 33.08%.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #250      +/-   ##
==========================================
+ Coverage   33.05%   33.08%   +0.03%     
==========================================
  Files         537      537              
  Lines       28003    28026      +23     
==========================================
+ Hits         9255     9273      +18     
- Misses      18748    18753       +5     
Files Coverage Δ
core/lib/merkle_tree/src/storage/rocksdb.rs 66.66% <ø> (ø)
core/lib/merkle_tree/tests/integration/domain.rs 92.30% <ø> (ø)
core/lib/state/src/rocksdb/mod.rs 91.35% <ø> (+0.67%) ⬆️
core/lib/zksync_core/src/block_reverter/mod.rs 0.00% <ø> (ø)
...lib/zksync_core/src/metadata_calculator/helpers.rs 87.09% <100.00%> (-0.82%) ⬇️
core/lib/storage/src/db.rs 48.52% <48.71%> (-2.87%) ⬇️

... and 21 files with indirect coverage changes

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@slowli slowli marked this pull request as ready for review October 18, 2023 10:46
@slowli slowli requested a review from a team as a code owner October 18, 2023 10:46
@slowli slowli added this pull request to the merge queue Oct 18, 2023
Merged via the queue into main with commit 650124c Oct 18, 2023
27 checks passed
@slowli slowli deleted the aov-pla-629-investigate-write-stalls-in-rocksdb branch October 18, 2023 11:31
github-merge-queue bot pushed a commit that referenced this pull request Oct 24, 2023
🤖 I have created a release *beep* *boop*
---


##
[16.1.0](core-v16.0.2...core-v16.1.0)
(2023-10-24)


### Features

* Add new commitments
([#219](#219))
([a19256e](a19256e))
* arm64 zk-environment rust Docker images and other
([#296](#296))
([33174aa](33174aa))
* **config:** Extract everything not related to the env config from
zksync_config crate
([#245](#245))
([42c64e9](42c64e9))
* **eth-watch:** process governor upgrades
([#247](#247))
([d250294](d250294))
* **merkle tree:** Expose Merkle tree API
([#209](#209))
([4010c7e](4010c7e))
* **merkle tree:** Snapshot recovery for Merkle tree
([#163](#163))
([9e20703](9e20703))
* **multivm:** Remove lifetime from multivm
([#218](#218))
([7eda27c](7eda27c))
* Remove fee_ticker and token_trading_volume fetcher modules
([#262](#262))
([44f7179](44f7179))
* **reorg_detector:** compare miniblock hashes for reorg detection
([#236](#236))
([2c930b2](2c930b2))
* Rewrite server binary to use `vise` metrics
([#120](#120))
([26ee1fb](26ee1fb))
* **types:** introduce state diff record type and compression
([#194](#194))
([ccf753c](ccf753c))
* **vm:** Improve tracer trait
([#121](#121))
([ff60138](ff60138))
* **vm:** Move all vm versions to the one crate
([#249](#249))
([e3fb489](e3fb489))


### Bug Fixes

* **crypto:** update snark-vk to be used in server and update args for
proof wrapping
([#240](#240))
([4a5c54c](4a5c54c))
* **db:** Fix write stalls in RocksDB
([#250](#250))
([650124c](650124c))
* **db:** Fix write stalls in RocksDB (again)
([#265](#265))
([7b23ab0](7b23ab0))
* **db:** Fix write stalls in RocksDB (for real this time)
([#292](#292))
([0f15919](0f15919))
* Fix `TxStage` string representation
([#255](#255))
([246b5a0](246b5a0))
* fix typos
([#226](#226))
([feb8a6c](feb8a6c))
* **witness-generator:** Witness generator oracle with cached storage
refunds ([#274](#274))
([8928a41](8928a41))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants