Skip to content

Add GitHub Actions workflow step to add summary for test-runner results #2719

Open
@sanderploegsma

Description

@sanderploegsma

The GitHub Actions workflow that runs the tests using the Java test runner currently doesn't provide very useful output (example). We can look into creating a custom action step to create a job summary from the JSON output, perhaps using actions/github-script.

This step should then at least provide:

  • A job summary containing the name/slug of each tested exercise, with a total pass/fail count per exercise. Perhaps using a summary table.
  • The .tests[].message for each failed test in each test-runner JSON file, perhaps by using annotations.
  • The .message for each test-runner JSON file with status error, perhaps also by using annotations.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions