Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

config/zonepb: increase default range size from 64/16 MB to 512/128 MB #45209

Merged

Conversation

ajwerner
Copy link
Contributor

@ajwerner ajwerner commented Feb 19, 2020

This change increases the default range size by a factor of 8.
There has been a good bit of manual testing at a much larger
configuration of 64/16GB. At that configuration several issues
were observed and will continue to be worked through. At this size
no negative implications are anticipated.

Release note (general change): New clusters will have a larger default
range size which will result in fewer ranges for the same amount of data.

…28MB

This change increases the default range size by a factor of 8.
There has been a good bit of manual testing at a much larger
configuration of 64/16GB. At that configuration several issues
were observed and will continue to be worked through. At this size
no negative implications are anticipated.

Release note (general change): New clusters will have a larger default
range size which should enable greater storage density.
@cockroach-teamcity
Copy link
Member

This change is Reviewable

@ajwerner ajwerner changed the title config/zonepb: increase default range size from 64/16 MB to 512/112 MB config/zonepb: increase default range size from 64/16 MB to 512/128 MB Feb 19, 2020
Copy link
Contributor

@knz knz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thank you Andrew!

@ajwerner
Copy link
Contributor Author

bors r=knz

@knz
Copy link
Contributor

knz commented Feb 19, 2020

Note that your release note still mentions "greater storage density" although you had reservations about that yesterday. Do you want to add more words to be more specific about what users can expect? The docs team will welcome that too.

@ajwerner
Copy link
Contributor Author

bors r-

@craig
Copy link
Contributor

craig bot commented Feb 19, 2020

Canceled

@ajwerner
Copy link
Contributor Author

Note that your release note still mentions "greater storage density" although you had reservations about that yesterday. Do you want to add more words to be more specific about what users can expect? The docs team will welcome that too.

I've made the note more vague. I would like to revise it with the docs team after we gather more data on the true implications.

@ajwerner
Copy link
Contributor Author

bors r=knz

craig bot pushed a commit that referenced this pull request Feb 19, 2020
45209: config/zonepb: increase default range size from 64/16 MB to 512/128 MB r=knz a=ajwerner

This change increases the default range size by a factor of 8.
There has been a good bit of manual testing at a much larger
configuration of 64/16GB. At that configuration several issues
were observed and will continue to be worked through. At this size
no negative implications are anticipated.

Release note (general change): New clusters will have a larger default
range size which will result in fewer ranges for the same amount of data. 

Co-authored-by: Andrew Werner <ajwerner@cockroachlabs.com>
@craig
Copy link
Contributor

craig bot commented Feb 19, 2020

Build succeeded

@craig craig bot merged commit 660b3e7 into cockroachdb:master Feb 19, 2020
ajwerner added a commit to ajwerner/cockroach that referenced this pull request Feb 26, 2020
…e size

In cockroachdb#45209 we increased the default range size. The test used hard-codes values.
This commit looks up the expected values from the database.

Fixes cockroachdb#37822.

Release note: None
craig bot pushed a commit that referenced this pull request Feb 26, 2020
45451: roachtest: fix copy/bank for new range sizes r=nvanbenschoten a=ajwerner

In #45209 we increased the default range size. The test used hard-codes values.
This commit looks up the expected values from the database.

Fixes #37822.

Release note: None

Co-authored-by: Andrew Werner <ajwerner@cockroachlabs.com>
@rmloveland
Copy link
Collaborator

@ajwerner FYI the release notes script only picks up release note text from git commits, not the PR description in the Github UI. I updated the release note to match your text, with one change to specify the range size.

So it will look like this:

New clusters will have a larger default range size of 512 MB, which will result in fewer ranges for the same amount of data.

If you want to discuss more I can tag you when I make the release notes PR in a bit.

@rmloveland
Copy link
Collaborator

20.1 beta 2 release notes PR is here, if you want any changes to the wording in addition to that I shared above: cockroachdb/docs#6715

@ajwerner
Copy link
Contributor Author

Thanks @rmloveland, this all SGTM!

@ajwerner
Copy link
Contributor Author

ajwerner commented Apr 3, 2020

Thanks @davygeek, that was pretty egregious. Fixed in #46953

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants