New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[AGE-391] [bug] LLM invocation errors are not correctly shown in the evaluation detail view #1850

Closed

mmabrouk opened this issue Jul 5, 2024 · 1 comment

Labels

Backend bug Frontend Medium priority

Milestone

Member

mmabrouk commented Jul 5, 2024

To reproduce:

Create an llm application with a wrong LLM API key
Call the llm application from the playground. You will see that the error traceback explains that the error is a wrong API key
Run an evaluation on the variant. The error will include the correct status (401) but the message shown in the modal is uninformative.

The issue is either that:

The modal is not showing the correct information (the detail and traceback)
The backend is not saving the correct information

_{From SyncLinear.com | AGE-391}

mmabrouk added Backend bug Frontend Medium priority labels

Member Author

mmabrouk commented Jul 5, 2024

https://agenta-hq.slack.com/archives/C05JT3NQB1R/p1720196534178239?thread_ts=1720196465.879799&cid=C05JT3NQB1R for examples

mmabrouk added this to the v.53 milestone

mmabrouk closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment