Skip to content

[Obs AI Assistant] Add GPT-5 ratings to the LLM performance matrix #3816

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 3 commits into from
Nov 5, 2025
Merged

[Obs AI Assistant] Add GPT-5 ratings to the LLM performance matrix #3816

merged 3 commits into from
Nov 5, 2025

Conversation

@viduni94
Copy link
Contributor

@viduni94 viduni94 commented Nov 5, 2025 •
edited
Loading

Closes https://github.com/elastic/obs-ai-assistant-team/issues/374

This PR adds the performance ratings of GPT-5 to the Observability AI Assistant LLM performance matrix.

image

@viduni94 viduni94 self-assigned this Nov 5, 2025
@viduni94 viduni94 requested a review from a team as a code owner November 5, 2025 00:43
@viduni94 viduni94 added documentation Improvements or additions to documentation v9.2.0 labels Nov 5, 2025
@github-actions
Copy link

github-actions bot commented Nov 5, 2025 •
edited
Loading

🔍 Preview links for changed docs

mdbirnstiehl
mdbirnstiehl approved these changes Nov 5, 2025
View reviewed changes
Copy link
Contributor

@mdbirnstiehl mdbirnstiehl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@viduni94
Copy link
Contributor Author

viduni94 commented Nov 5, 2025 •
edited
Loading

The bug with the Kibana connector for GPT-5 has been solved for the OpenAI provider (only Azure OpenAI is still pending.)
Therefore, added evaluation results for GPT-5 with OpenAI as the provider instead of GPT-5-Chat as it's not recommended for API usage.
cc: @pmoust

@viduni94 viduni94 requested a review from pmoust November 5, 2025 16:17
arturoliduena
arturoliduena approved these changes Nov 5, 2025
View reviewed changes
Copy link
Contributor

@arturoliduena arturoliduena left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@viduni94 viduni94 merged commit d92b0a8 into elastic:main Nov 5, 2025
7 checks passed
@viduni94 viduni94 changed the title [Obs AI Assistant] Add GPT-5-Chat ratings to the LLM performance matrix [Obs AI Assistant] Add GPT-5 ratings to the LLM performance matrix Nov 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@pmoust pmoust pmoust approved these changes

@arturoliduena arturoliduena arturoliduena approved these changes

@mdbirnstiehl mdbirnstiehl mdbirnstiehl approved these changes

Assignees

@viduni94 viduni94

Labels

documentation Improvements or additions to documentation v9.2.0

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@viduni94 @pmoust @arturoliduena @mdbirnstiehl