Skip to content

Distinguish Test Failures and Errors#24

Merged
sator-imaging merged 3 commits into
mainfrom
feat/differentiate-failure-error-12988446077426713647
Feb 15, 2026
Merged

Distinguish Test Failures and Errors#24
sator-imaging merged 3 commits into
mainfrom
feat/differentiate-failure-error-12988446077426713647

Conversation

@google-labs-jules
Copy link
Copy Markdown
Contributor

This change differentiates between test failures (FUnitException) and errors (other exceptions) to provide more specific feedback on test outcomes.


PR created automatically by Jules for task 12988446077426713647 started by @sator-imaging

This commit introduces a distinction between test "failures" and "errors".

- A test is considered "failed" if it throws an `FUnitException`.
- A test is considered to have an "error" if it throws any other type of exception.

This change provides more granular information about the outcome of a test run, allowing users to quickly identify whether a test failed due to an assertion or an unexpected issue.
@google-labs-jules
Copy link
Copy Markdown
Contributor Author

👋 Jules, reporting for duty! I'm here to lend a hand with this pull request.

When you start a review, I'll add a 👀 emoji to each comment to let you know I've read it. I'll focus on feedback directed at me and will do my best to stay out of conversations between you and other bots or reviewers to keep the noise down.

I'll push a commit with your requested changes shortly after. Please note there might be a delay between these steps, but rest assured I'm on the job!

For more direct control, you can switch me to Reactive Mode. When this mode is on, I will only act on comments where you specifically mention me with @jules. You can find this option in the Pull Request section of your global Jules UI settings. You can always switch back!

New to Jules? Learn more at jules.google/docs.


For security, I will only act on instructions from the user who triggered this task.

This commit introduces a distinction between test failures and errors in the test reporting.

A test is now classified as:
- **Failed**: If it throws an `FUnitException`. This typically represents an assertion failure.
- **Errored**: If it throws any other type of exception. This represents an unexpected runtime error within the test.

This is achieved by adding an `IsFailure` property to the `TestResult.Error` record. The console logger is updated to use this property to display the correct classification and provide separate counts in the final summary.

This change provides more granular and accurate feedback on test outcomes, helping users to more quickly diagnose the root cause of a problem.
@sator-imaging sator-imaging marked this pull request as ready for review February 1, 2026 09:17
@sator-imaging sator-imaging self-requested a review as a code owner February 1, 2026 09:17
Comment thread src/FUnit.cs Outdated
This commit addresses a comment on the pull request to change the wording in the console output from 'Errored' to 'Error'.
@sator-imaging sator-imaging merged commit e23761e into main Feb 15, 2026
2 checks passed
@sator-imaging sator-imaging deleted the feat/differentiate-failure-error-12988446077426713647 branch February 15, 2026 00:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant