Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[experiments] print evaluator errors to console #3675

Closed
Tracked by #2017
axiomofjoy opened this issue Jun 26, 2024 · 1 comment
Closed
Tracked by #2017

[experiments] print evaluator errors to console #3675

axiomofjoy opened this issue Jun 26, 2024 · 1 comment
Assignees
@axiomofjoy
Labels
enhancement New feature or request

Comments

@axiomofjoy
Copy link
Contributor

axiomofjoy commented Jun 26, 2024 •
edited
Loading

It's difficult right now to understand what is going wrong when a user incorrectly implements an evaluator. We should print errors to the console to help users quickly debug what is going wrong.
@axiomofjoy axiomofjoy mentioned this issue Jun 26, 2024
Closed
@github-project-automation github-project-automation bot moved this to 📘 Todo in phoenix Jun 26, 2024
@dosubot dosubot bot added the enhancement New feature or request label Jun 26, 2024
@axiomofjoy axiomofjoy self-assigned this Jun 28, 2024
@axiomofjoy axiomofjoy moved this from 📘 Todo to 👨‍💻 In progress in phoenix Jun 28, 2024
@axiomofjoy
Copy link
Contributor Author

Looks like we've added a top_error column to the evaluator summary. Going to punt on this until someone asks for it.

@github-project-automation github-project-automation bot moved this from 👨‍💻 In progress to ✅ Done in phoenix Jun 29, 2024
@axiomofjoy axiomofjoy mentioned this issue Jul 2, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@axiomofjoy axiomofjoy

Labels
enhancement New feature or request
Projects
phoenix
Archived in project
Milestone
No milestone
Development

No branches or pull requests
1 participant
@axiomofjoy