Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Load stores lazily #2146

Merged
merged 2 commits into from
Mar 14, 2022
Merged

Load stores lazily #2146

merged 2 commits into from
Mar 14, 2022

Conversation

dominiklohmann
Copy link
Member

@dominiklohmann dominiklohmann commented Mar 11, 2022

This causes local segment stores of passive partitions to be loaded lazily, i.e., initialized only after the actor received its first message.

📝 Checklist

  • All user-facing changes have changelog entries.
  • The changes are reflected on docs.tenzir.com/vast, if necessary.
  • The PR description contains instructions for the reviewer, if necessary.

🎯 Review Instructions

I was unable to reproduce the behavior from the removed comment locally. Please make sure this also holds true for other platforms.

It'd be great to measure this—if the impact is big, then we probably want to add a changelog entry.

@dominiklohmann dominiklohmann added the performance Improvements or regressions of performance label Mar 11, 2022
@dominiklohmann dominiklohmann requested a review from lava March 11, 2022 16:57
@dominiklohmann
Copy link
Member Author

I added a changelog entry. After measuring locally, this turned out to have a visible effect for a small test database with 100 partitions. Quantifying the speed up does not make sense here, as it is highly dependent on the disk speeds and the operating system's scheduling of file reads / mmaps.

Copy link
Member

@lava lava left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice, always good to see problems go away automatically over time :D

@dominiklohmann dominiklohmann merged commit 1171e86 into master Mar 14, 2022
@dominiklohmann dominiklohmann deleted the story/sc-32230/lazily-load-stores branch March 14, 2022 11:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
performance Improvements or regressions of performance
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants