Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix issue with PerfBenchmarkRunner where server can no longer pre-load segments from dataDir. #5417

Merged
merged 1 commit into from
May 20, 2020

Conversation

mayankshriv
Copy link
Contributor

Due to recent PRs (#5383, #5381), PerfBenchmarkRunner now makes additional copy
of segments on controller, and makes server download data from controller.
The original behavior was to bypass this and for servers to directly preload
from disk. This PR is undoing the changes from above PR to get back to old
behavior that is more optimal.

Copy link
Contributor

@jackjlli jackjlli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall LGTM. It'd be good to put more description on dataDir as the name is so generic and doesn't show it's to save the time of loading segments.

@mayankshriv mayankshriv force-pushed the perf-runner branch 2 times, most recently from 434d07b to d5afd3d Compare May 20, 2020 03:11
…d segments

from dataDir.

Due to recent PRs (apache#5383, apache#5381), PerfBenchmarkRunner now makes additional copy
of segments on controller, and makes server download data from controller.
The original behavior was to bypass this and for servers to directly preload
from disk. This PR is undoing the changes from above PR to get back to old
behavior that is more optimal.
@mayankshriv mayankshriv merged commit 4e3f062 into apache:master May 20, 2020
@mayankshriv mayankshriv deleted the perf-runner branch May 20, 2020 04:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants