Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support search slicing with point-in-time #75162

Merged
merged 5 commits into from
Jul 9, 2021

Conversation

jtibshirani
Copy link
Contributor

Backport of #74457.

jtibshirani and others added 3 commits July 8, 2021 15:55
This PR adds support for using the `slice` option in point-in-time searches. By
default, the slice query splits documents based on their Lucene ID. This
strategy is more efficient than the one used for scrolls, which is based on the
`_id` field and must iterate through the whole terms dictionary. When slicing a
search, the same point-in-time ID must be used across slices to guarantee the
partitions don't overlap or miss documents.

Closes elastic#65740.
@jtibshirani jtibshirani added >enhancement :Search/Search Search-related issues that do not fall into other categories backport labels Jul 8, 2021
@elasticmachine elasticmachine added the Team:Search Meta label for search team label Jul 8, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-search (Team:Search)

@jtibshirani jtibshirani merged commit 52c0bda into elastic:7.x Jul 9, 2021
@jtibshirani jtibshirani deleted the slice-query branch July 9, 2021 18:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport >enhancement :Search/Search Search-related issues that do not fall into other categories Team:Search Meta label for search team v7.15.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants