Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Discover] Show indication for failed documents and switch to view #185927

Open
flash1293 opened this issue Jun 11, 2024 · 2 comments
Open

[Discover] Show indication for failed documents and switch to view #185927

flash1293 opened this issue Jun 11, 2024 · 2 comments
Labels
Project:OneDiscover Enrich Discover with contextual awareness Team:DataDiscovery Discover, search (e.g. data plugin and KQL), data views, saved searches. For ES|QL, use Team:ES|QL. Team:obs-ux-logs Observability Logs User Experience Team

Comments

@flash1293
Copy link
Contributor

#184092 paves the way to explore failure store documents in Discover.

However, the scope of the linked issue is only about the raw functionality enabled by a query parameter.

To make this feature useful for users currently using Discover, two parts are necessary:

  • For the current data view, check whether there are failure store documents in the current time range. If that's the case, show a small indicator in the UI that signals "The data you are viewing might not be complete, some documents were not indexed correctly".
  • There is a way to "flip on" the query parameter to show the failure documents. There are multiple ways how this could look like:
    • Just add the query parameter - currently selected columns might not fit well
    • Open a separate view in a new tab with the relevant columns preselected

Implementation notes

  • For ESQL, this depends on ESQL: Allow access to failure store elasticsearch#108559
  • To determine whether there are failed docs, we can take the current index pattern (either via data view or via from clause of the ESQL query) and query it for the current time range, just retrieving a single document ("size": 1 / | limit 1) - if this returns something, we have failed documents. This request can happen in the background, not blocking the other user-visible data requests
@flash1293 flash1293 added Team:DataDiscovery Discover, search (e.g. data plugin and KQL), data views, saved searches. For ES|QL, use Team:ES|QL. Team:obs-ux-logs Observability Logs User Experience Team Project:OneDiscover Enrich Discover with contextual awareness labels Jun 11, 2024
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-data-discovery (Team:DataDiscovery)

@elasticmachine
Copy link
Contributor

Pinging @elastic/obs-ux-logs-team (Team:obs-ux-logs)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Project:OneDiscover Enrich Discover with contextual awareness Team:DataDiscovery Discover, search (e.g. data plugin and KQL), data views, saved searches. For ES|QL, use Team:ES|QL. Team:obs-ux-logs Observability Logs User Experience Team
Projects
None yet
Development

No branches or pull requests

2 participants