Skip to content

Evaluation: Clear error message #693

@AkhileshNegi

Description

@AkhileshNegi

Is your feature request related to a problem?
When you run an evaluation using a config with the GPT-4 Turbo model, the error message isn’t clear. It’s hard to tell what went wrong, which can confuse users and interrupt the workflow.

To Reproduce
Steps to reproduce the behavior:

  1. Go to Config and create a new version using the GPT-4 Turbo model
  2. Go to Evaluation → Text
  3. Open the Evaluation tab
  4. Add a name, pick a config, and select a dataset
  5. Click “Run evaluation” — an error shows up in the right sidebar

Expected behavior
Running evaluation with Config should run successfully

Screenshots

Image

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

Status

To Do

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions