Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

avoid adding to 'uncleaned_roots' when generating index and caller pa… #25936

Merged
merged 1 commit into from
Jun 14, 2022

Conversation

jeffwashington
Copy link
Contributor

@jeffwashington jeffwashington commented Jun 13, 2022

…sses accounts-db-skip-shrink

Problem

See comment in change.
In high account count simulations, this causes validators to oom on the first clean in the bg.
The issue is also caused by the acct idx keeping items in-mem after they are scanned by clean. Clean can also be modified to not keep items in the acct idx if a scan determines they are not interesting to clean.

Summary of Changes

Don't add all roots to 'uncleaned_roots' at startup when --accounts-db-skip-shrink is passed.

Fixes #

@jeffwashington jeffwashington marked this pull request as ready for review June 13, 2022 18:03
@codecov
Copy link

codecov bot commented Jun 13, 2022

Codecov Report

Merging #25936 (52aca61) into master (8caced6) will decrease coverage by 0.1%.
The diff coverage is 77.5%.

@@            Coverage Diff            @@
##           master   #25936     +/-   ##
=========================================
- Coverage    82.1%    82.0%   -0.2%     
=========================================
  Files         628      631      +3     
  Lines      171471   172929   +1458     
=========================================
+ Hits       140878   141878   +1000     
- Misses      30593    31051    +458     

Copy link
Contributor

@brooksprumo brooksprumo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me

@jeffwashington jeffwashington merged commit e24cc53 into solana-labs:master Jun 14, 2022
jeffwashington added a commit to jeffwashington/solana that referenced this pull request Jul 6, 2022
…aller passes accounts-db-skip-shrink (solana-labs#25936)"

This reverts commit e24cc53.
jeffwashington added a commit that referenced this pull request Jul 6, 2022
#26441)

Revert "avoid adding to 'uncleaned_roots' when generating index and caller passes accounts-db-skip-shrink (#25936)"

This reverts commit e24cc53.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants