Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add exponential growth to TimeLimitingBulkScorer #11984

Merged
merged 4 commits into from
Dec 2, 2022
Merged

Conversation

costin
Copy link
Contributor

@costin costin commented Nov 29, 2022

Increase the timeout check inside TimeLimitBulkScorer at exponential rate.

Fix #11676

Copy link
Contributor

@jpountz jpountz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I left a question about the test but otherwise it looks great, I like that the test checks a long range of doc IDs without having to actually index docs.

expectedInterval = lastInterval;
}
// keep going or finish the test?
return --runs == 0 ? DocIdSetIterator.NO_MORE_DOCS : 0;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why would we end prematurely instead of doing the checks on the full range? Is it to avoid the corner case of the last range, which might be smaller than the expected interval? Maybe the bulk scorer could record the segment's maxDoc and allow the difference to be less than expectedInterval if the max doc is equal to maxDoc?

Copy link
Contributor

@jpountz jpountz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Can you add a CHANGES entry under 9.5?

@costin
Copy link
Contributor Author

costin commented Nov 30, 2022

LGTM. Can you add a CHANGES entry under 9.5?

Done.

@dnhatn
Copy link
Member

dnhatn commented Dec 2, 2022

Thanks @costin!

@dnhatn dnhatn merged commit 4eba6a1 into apache:main Dec 2, 2022
@costin costin deleted the fix/11676 branch December 2, 2022 18:00
jpountz pushed a commit that referenced this pull request Dec 14, 2022
Increase the timeout check inside TimeLimitBulkScorer at exponential rate.

Fix #11676
@rmuir rmuir added this to the 9.5.0 milestone Jan 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Can TimeLimitingBulkScorer exponentially grow the window size? [LUCENE-10640]
4 participants