Skip to content

Internal benchmark results upload crashes if there's no error column in the result table #544

@R-Palazzo

Description

@R-Palazzo

Environment Details

  • SDGym version: 0.13.0

Error Description

The upload benchmark fails because it tries to count datasets that timed out or errored out based on the Error column, but when no jobs fail, the Error column is removed, causing a crash. We should be able to compute the Model.xlsx table even without error columns, assuming zero datasets failed in this case.

Steps to reproduce

To reproduce it, one can run:

invoke upload-benchmark-results --modality "single_table"

Here is an example of workflow failing

Metadata

Metadata

Assignees

Labels

bugSomething isn't workinginternalThe issue doesn't change the API or functionality

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions