Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Load stores lazily #2146

Merged
merged 2 commits into from Mar 14, 2022
Merged

Load stores lazily #2146

merged 2 commits into from Mar 14, 2022

Conversation

dominiklohmann
Copy link
Member

@dominiklohmann dominiklohmann commented Mar 11, 2022

This causes local segment stores of passive partitions to be loaded lazily, i.e., initialized only after the actor received its first message.

馃摑 Checklist

  • All user-facing changes have changelog entries.
  • The changes are reflected on docs.tenzir.com/vast, if necessary.
  • The PR description contains instructions for the reviewer, if necessary.

馃幆 Review Instructions

I was unable to reproduce the behavior from the removed comment locally. Please make sure this also holds true for other platforms.

It'd be great to measure this鈥攊f the impact is big, then we probably want to add a changelog entry.

@dominiklohmann dominiklohmann added the performance Improvements or regressions of performance label Mar 11, 2022
@dominiklohmann
Copy link
Member Author

I added a changelog entry. After measuring locally, this turned out to have a visible effect for a small test database with 100 partitions. Quantifying the speed up does not make sense here, as it is highly dependent on the disk speeds and the operating system's scheduling of file reads / mmaps.

Copy link
Member

@lava lava left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice, always good to see problems go away automatically over time :D

@dominiklohmann dominiklohmann merged commit 1171e86 into master Mar 14, 2022
@dominiklohmann dominiklohmann deleted the story/sc-32230/lazily-load-stores branch March 14, 2022 11:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
performance Improvements or regressions of performance
Projects
None yet
2 participants