New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Correct profiled rewrite time for knn with a pre-filter #104150
Correct profiled rewrite time for knn with a pre-filter #104150
Conversation
Hi @benwtrent, I've created a changelog YAML for you. |
Pinging @elastic/es-search (Team:Search) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The changes LGTM.
Should we test the rewrite time in the profile results? Would it make sense to check that stopAndAddRewriteTime
has been called N times depending on the query structure?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
neat, thanks for fixing
@elasticmachine update branch |
@elasticmachine update branch |
kNN profiling will fire multiple rewrite actions in a row without stopping a previous one. Right now, this means in production, the rewrite times are inaccurate for knn with a prefilter as we inaccurately calculate the total time (prefilter rewrite & knn rewrite). This adjusts the interface for rewriting timing to allow concurrent rewriters which then each can update the total rewrite time that we return to the user. Relates to: elastic#104131
kNN profiling will fire multiple rewrite actions in a row without stopping a previous one. Right now, this means in production, the rewrite times are inaccurate for knn with a prefilter as we inaccurately calculate the total time (prefilter rewrite & knn rewrite).
This adjusts the interface for rewriting timing to allow concurrent rewriters which then each can update the total rewrite time that we return to the user.
Relates to: #104131