[ML] AIOps: Adds AI Assistant contextual insight to Log Rate Analysis page in ML plugin in Observability serverless.

[walterra]

Summary

Part of #181111.

This adds O11y AI Assistant's contextual insight to the Log Rate Analysis page in the ML plugin for O11y serverless projects..

Note the code is almost an exact copy of what's currently used in the O11y UI itself to render the contextual insight when log rate analysis gets embedded on alert details pages. As a follow up we will be able to consolidate some code.

aiops-ai-assistant-contextual-insight-0001.webm

To test this you need to set up AI Assistant in your kibana.dev.yml:

xpack.actions.preconfigured:
  my-gen-ai:
    name: Preconfigured Azure OpenAi
    actionTypeId: .gen-ai
    config:
      apiUrl: <YOUR-API-URL>
      apiProvider: 'Azure OpenAI'
    secrets:
      apiKey: <YOUR-API-KEY>

Checklist

• Unit or functional tests were updated or added to match the most common scenarios
• This was checked for breaking API changes and was labeled appropriately

[elasticmachine]

Pinging @elastic/ml-ui (:ml)

[kibana-ci]

💚 Build Succeeded

• Buildkite Build
• Commit: 08dbaa2

Metrics [docs]

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id	before	after	diff
aiops	554.2KB	558.0KB	+3.8KB
ml	4.1MB	4.1MB	+106.0B
total			+3.9KB

Page load bundle

Size of the bundles that are downloaded on every page load. Target size is below 100kb

id	before	after	diff
ml	80.2KB	80.2KB	+52.0B

Unknown metric groups

API count

id	before	after	diff
aiops	72	73	+1

History

• 💔 Build #216849 failed 83a7cd9
• 💔 Build #216846 failed a897ede

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

cc @walterra

[peteharverson]

Should we clear this info if the brushes are reset or when a new analysis is run?

[peteharverson]

Added this to #181111. I think it makes sense to clear the reset AI assistant section when Reset is pressed or when a new analysis is run.

[peteharverson]

Tested locally against a range of logs, and overall looks a great addition.

Couple of questions:

1. Guessing this is the default behavior of the AI assistant, but is there a way to prevent this toast from appearing if a user decides to click the 'Stop generating' button:

2. Have you confirmed that behavior is ok with Security and Search serverless projects (assume the assistant is just silently hidden)?

[walterra]

@peteharverson regarding your questions:

1. That error toast also shows up in other places for contextual insights. I contacted the o11y team to find out if we can fix this. Update: This is now tracked by an o11y issue: [Observability AI Assistant] "Stop generating" shows an error toast #186794
2. I tested the behavior across serverless projects:

• o11y: Log rate analysis is available in the main menu and works including the contextual insight.
• es/security: Log rate analysis is not in the main menus but available when you search for it. The o11y AI assistant is not enabled in these projects so the contextual insights section is hidden on the log rate analysis page.
• security: Log rate analysis is available within "Machine Learning" from the main menu. The o11y AI assistant is not enabled in this project so the contextual insights section is hidden on the log rate analysis page.

[peteharverson]

LGTM

[alvarezmelissa87]

Great addition! Overall everything works as expected except the 'Start chat' button, which doesn't seem to do anything. Maybe it can be removed if it doesn't work outside of Observability?

[walterra]

@alvarezmelissa87 I investigated the non-working "Start chat" button. The problem is: This button will trigger the AI Assistant flyout to start a chat with the assistant, but it is not available outside the o11y UI on stateful. The contextual insight on the other hand doesn't expose options to hide that button in this case. Since the AI assistant chat is only available all the time in the o11y project type for serverless, for now I had to add a flag that will show the contextual insights on the log rate analysis page on serverless too (see d7aa6f4).

[elasticmachine]

💚 Build Succeeded

• Buildkite Build
• Commit: 506b594

Metrics [docs]

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id	before	after	diff
aiops	559.1KB	563.0KB	+3.9KB
ml	4.6MB	4.6MB	+344.0B
total			+4.3KB

Page load bundle

Size of the bundles that are downloaded on every page load. Target size is below 100kb

id	before	after	diff
ml	80.3KB	80.3KB	+52.0B

Unknown metric groups

API count

id	before	after	diff
aiops	72	74	+2

History

• 💔 Build #219242 failed d7aa6f4

cc @walterra