Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closes #2793 to improve sync performance by increasing default value of dbcache. #2873

Merged
merged 3 commits into from Jan 20, 2018

Conversation

bitcartel
Copy link
Contributor

No description provided.

@bitcartel bitcartel added the I-performance Problems and improvements with respect to performance label Jan 16, 2018
@bitcartel bitcartel added this to the 1.0.15 milestone Jan 16, 2018
@bitcartel bitcartel self-assigned this Jan 16, 2018
Copy link
Contributor

@str4d str4d left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

General utACK, but see comment.

Notable changes
===============

UTXO memory accounting
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Put these in doc/release-notes.md, which gets inserted into the correct release notes file at release time. This also means you can just cherry-pick upstream commits directly, and their release notes will go into the correct place.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ok, done.

Copy link
Contributor

@str4d str4d left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

utACK after doc comment is addressed.

UTXO memory accounting
----------------------

The default -dbcache has also been changed in this release to 450MiB. Users can set -dbcache to a higher value (e.g. to keep the UTXO more fully cached in memory). Users on low-memory systems (such as systems with 1GB or less) should consider specifying a lower value for this parameter.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Non-blocking: has been changed (non-blocking because I expect other changes will be added that can go before this, to make it grammatically correct).

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done


The size of some in-memory caches can be reduced. As caches trade off memory usage for performance, usually reducing these have a negative effect on performance.

- `-dbcache=<n>` - the UTXO database cache size, this defaults to `450` (`100` before 1.0.15). The unit is MiB (1024)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The (1024) seems like a typo. Maybe expand to (where 1 GiB = 1024 MiB) or something similar?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

The size of some in-memory caches can be reduced. As caches trade off memory usage for performance, usually reducing these have a negative effect on performance.

- `-dbcache=<n>` - the UTXO database cache size, this defaults to `450` (`100` before 1.0.15). The unit is MiB (1024)
- The minimum value for `-dbcache` is 4.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Document max?

Copy link
Contributor Author

@bitcartel bitcartel Jan 18, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Depends on the platform, so won't document here. Note that zcashd --help already displays the max amount: Set database cache size in megabytes (4 to 16384, default: 450)

@arcalinea
Copy link
Contributor

ACK.

@zkbot try

@zkbot
Copy link
Contributor

zkbot commented Jan 17, 2018

⌛ Trying commit 1f2f9e8 with merge 501cd38...

zkbot added a commit that referenced this pull request Jan 17, 2018
Closes #2793 to improve sync performance by increasing default value of dbcache.
@zkbot
Copy link
Contributor

zkbot commented Jan 17, 2018

☀️ Test successful - pr-try
State: approved= try=True

Adapted from documentation 'Reducing bitcoind memory usage' by @laanwj
https://gist.github.com/laanwj/efe29c7661ce9b6620a7
@bitcartel
Copy link
Contributor Author

@str4d updated documentation

Copy link
Contributor

@str4d str4d left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

utACK. Merge when ready 😄

UTXO memory accounting
----------------------

The default -dbcache has been changed in this release to 450MiB. Users can set -dbcache to a higher value (e.g. to keep the UTXO more fully cached in memory). Users on low-memory systems (such as systems with 1GB or less) should consider specifying a lower value for this parameter.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Non-blocking: "to keep the UTXO set"

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

@bitcartel
Copy link
Contributor Author

@zkbot r+

@zkbot
Copy link
Contributor

zkbot commented Jan 20, 2018

📌 Commit d2b77b7 has been approved by bitcartel

@zkbot
Copy link
Contributor

zkbot commented Jan 20, 2018

⌛ Testing commit d2b77b7 with merge 38246ea...

zkbot added a commit that referenced this pull request Jan 20, 2018
Closes #2793 to improve sync performance by increasing default value of dbcache.
@zkbot
Copy link
Contributor

zkbot commented Jan 20, 2018

☀️ Test successful - pr-merge
Approved by: bitcartel
Pushing 38246ea to master...

@zkbot zkbot merged commit d2b77b7 into zcash:master Jan 20, 2018
This was referenced Jan 20, 2018
@tearodactyl tearodactyl mentioned this pull request May 9, 2018
tearodactyl pushed a commit to tearodactyl/z18 that referenced this pull request May 9, 2018
Update version string
Pull in select 1.0.15 Zcash fixes:
read hashReserved from disk zcash#2931
improve sync performance by increasing default value of dbcache. zcash#2873
z_importviewingkey fix from leto/zero/pull/1
Update README.md throughout, particularly the addnode addresses, plus add a sample zero.conf to ./contrib
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
I-performance Problems and improvements with respect to performance
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants