Skip to content

Conversation

@viduni94
Copy link
Contributor

@viduni94 viduni94 commented Sep 19, 2025

Closes https://github.com/elastic/docs-content-internal/issues/349
Closes elastic/kibana#238610

This PR updates the Observability AI Assistant with the following changes:

  • Adds Qwen 2.5 72B to self-managed LLMs
  • Adds Claude Sonnet 4.5 to proprietary models
  • Updates the ES|QL rating for some models (with the introduction of unambiguous prompts for ES|QL scenarios, the scores and ratings changed slightly)

@viduni94 viduni94 self-assigned this Sep 19, 2025
@viduni94 viduni94 added documentation Improvements or additions to documentation v9.2.0 labels Sep 19, 2025
@github-actions
Copy link

github-actions bot commented Sep 19, 2025

🔍 Preview links for changed docs

@viduni94 viduni94 marked this pull request as ready for review October 22, 2025 18:19
@viduni94 viduni94 requested a review from a team as a code owner October 22, 2025 18:19
Copy link
Contributor

@mdbirnstiehl mdbirnstiehl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@viduni94
Copy link
Contributor Author

LGTM!

Thank you for the review @mdbirnstiehl

@viduni94 viduni94 changed the title [Obs AI Assistant] Add Qwen ratings to the LLM performance matrix [Obs AI Assistant] Add Qwen and Claude Sonnet 4.5 ratings to the LLM performance matrix Oct 22, 2025
@viduni94 viduni94 merged commit 7386257 into elastic:main Oct 23, 2025
7 checks passed
rhr323 pushed a commit to rhr323/docs-content that referenced this pull request Oct 27, 2025
…performance matrix (elastic#3056)

Closes elastic/docs-content-internal#349
Closes elastic/kibana#238610

This PR updates the Observability AI Assistant with the following
changes:
- Adds `Qwen 2.5 72B` to self-managed LLMs
- Adds `Claude Sonnet 4.5` to proprietary models
- Updates the ES|QL rating for some models (with the introduction of
[unambiguous prompts for ES|QL
scenarios](elastic/kibana#230774), the scores
and ratings changed slightly)
naemono pushed a commit to naemono/docs-content that referenced this pull request Oct 28, 2025
…performance matrix (elastic#3056)

Closes elastic/docs-content-internal#349
Closes elastic/kibana#238610

This PR updates the Observability AI Assistant with the following
changes:
- Adds `Qwen 2.5 72B` to self-managed LLMs
- Adds `Claude Sonnet 4.5` to proprietary models
- Updates the ES|QL rating for some models (with the introduction of
[unambiguous prompts for ES|QL
scenarios](elastic/kibana#230774), the scores
and ratings changed slightly)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation v9.2.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Obs AI Assistant] Evaluation of Claude Sonnet 4.5

4 participants