Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make persistence of sparse headers default behavior #7535

Merged
merged 1 commit into from
Mar 5, 2024

Conversation

56quarters
Copy link
Contributor

@56quarters 56quarters commented Mar 4, 2024

What this PR does

Remove the experimental flag to enable / disable persistence of sparse index-headers since the only behavior now is to persist them. The sparse versions have resulted and a huge performance improvement during lazy loading and there's no reason to not enable this behavior.

Which issue(s) this PR fixes or relates to

See #7521 (comment)

Checklist

  • Tests updated.
  • Documentation added.
  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX].
  • about-versioning.md updated with experimental features.

Remove the experimental flag to enable / disable persistence of sparse
index-headers since the only behavior now is to persist them. The sparse
versions have resulted and a huge performance improvement during lazy
loading and there's no reason to not enable this behavior.

See #7521 (comment)

Signed-off-by: Nick Pillitteri <nick.pillitteri@grafana.com>
@56quarters 56quarters marked this pull request as ready for review March 4, 2024 21:23
@56quarters 56quarters requested review from jdbaldry and a team as code owners March 4, 2024 21:23
Copy link
Contributor

@dimitarvdimitrov dimitarvdimitrov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

awesome, LGTM!

copying my comment from #7521:

The only thing I can think of is disk space but the amount of disk consumed by the sparse headers is trivial compared to the original versions

IIRC the overhead was less than 2% of the original index header size in all cases which I've investigated.

Since they were experimental up until my PR we can probably just remove the flag, right? I'm not sure if we suggested that people try out the flag while it was still experimental.

they were enabled by default in 2.11 with # 6005, so there's at least one version running them. They've also been enabled for all store-gateway zones at GL since r253 (~August). I think it's safe to delete them.

@56quarters 56quarters merged commit 803d3f1 into main Mar 5, 2024
29 checks passed
@56quarters 56quarters deleted the 56quarters/always-sparse branch March 5, 2024 00:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants