Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Close expired search contexts on SEARCH thread #99660

Conversation

DaveCTurner
Copy link
Contributor

In a production cluster, I observed the [scheduler] thread stuck for a
while trying to delete index files that became unreferenced while
closing a search context. We shouldn't be doing I/O on the scheduler
thread. This commit moves it to a SEARCH thread instead.

In a production cluster, I observed the `[scheduler]` thread stuck for a
while trying to delete index files that became unreferenced while
closing a search context. We shouldn't be doing I/O on the scheduler
thread. This commit moves it to a `SEARCH` thread instead.
@DaveCTurner DaveCTurner added >bug :Search/Search Search-related issues that do not fall into other categories v8.11.0 labels Sep 19, 2023
@elasticsearchmachine elasticsearchmachine added the Team:Search Meta label for search team label Sep 19, 2023
@elasticsearchmachine
Copy link
Collaborator

Hi @DaveCTurner, I've created a changelog YAML for you.

@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-search (Team:Search)

Copy link
Contributor

@romseygeek romseygeek left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@DaveCTurner DaveCTurner added the auto-merge Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) label Sep 19, 2023
@DaveCTurner
Copy link
Contributor Author

I'm marking this for backport, it looks to be quite a problem in this one (7.17) cluster.

@elasticsearchmachine elasticsearchmachine merged commit 1b1bf76 into elastic:main Sep 19, 2023
12 checks passed
@DaveCTurner DaveCTurner deleted the 2023/09/19/SearchService-Reaper-threading branch September 19, 2023 14:15
DaveCTurner added a commit that referenced this pull request Sep 19, 2023
In a production cluster, I observed the `[scheduler]` thread stuck for a
while trying to delete index files that became unreferenced while
closing a search context. We shouldn't be doing I/O on the scheduler
thread. This commit moves it to a `SEARCH` thread instead.
DaveCTurner added a commit that referenced this pull request Sep 19, 2023
In a production cluster, I observed the `[scheduler]` thread stuck for a
while trying to delete index files that became unreferenced while
closing a search context. We shouldn't be doing I/O on the scheduler
thread. This commit moves it to a `SEARCH` thread instead.
@masseyke masseyke added v8.10.3 and removed v8.10.2 labels Oct 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
auto-merge Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) >bug :Search/Search Search-related issues that do not fall into other categories Team:Search Meta label for search team v7.17.14 v8.10.3 v8.11.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants