Skip to content

test(analyzer): drive every mutation operator through the analyzer end to end - #105

Merged
samtrion merged 1 commit into
mainfrom
feat/analyzer-coverage-improvements
Aug 3, 2026
Merged

test(analyzer): drive every mutation operator through the analyzer end to end#105
samtrion merged 1 commit into
mainfrom
feat/analyzer-coverage-improvements

Conversation

@samtrion

@samtrion samtrion commented Aug 3, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Raises the Integration-project-only coverage of the mutation-testing analyzer from 56.7% to 83.4%, closing the gap flagged for the pre-existing analyzer (as opposed to the new Execution deliverable, which PR feat(execution): add execution-based mutation verification engine #104 already covers).
  • Every previously unit-tested-only operator (arithmetic, bitwise, boolean, conditional, equality, logical, nullable/numeric literals, checked/unchecked context, string/LINQ/math method renames, statement removal, collection initializers, the full regex mutation family), plus reachability, equivalence classification and the test-surface recognizers/generator, is now also driven end to end through the real MutationCoverageAnalyzer / TestSurfaceManifestGenerator pipeline, not just called directly the way the existing Unit suite already does.
  • Coverage after this change: Unit 91.6%, Integration 83.4%, combined 97.4%.

Test plan

  • dotnet build FrameShift.slnx - 0 warnings, 0 errors
  • dotnet test FrameShift.slnx - 31,678 tests passed across all 8 target frameworks (net6.0-net10.0, net472/net48/net481)
  • Verified Integration-only, Unit-only and combined coverage numbers with a real dotnet test --coverage + ReportGenerator run

…d to end

Raise the Integration-project-only coverage of the mutation-testing
analyzer from 56.7% to 83.4% by exercising the previously
unit-tested-only operators, regex infrastructure, reachability,
equivalence and test-surface recognizers through the real
MutationCoverageAnalyzer and TestSurfaceManifestGenerator pipelines,
the same way the existing CultureMutationTests and
TestSurfaceManifestGeneratorTests already do for their families.

Every new test asserts the exact set of reported diagnostics rather
than a bare count, and a couple of assertions are split by
target framework where a BCL member genuinely differs between modern
.NET and .NET Framework (Trim/TrimStart/TrimEnd overloads,
Enumerable.SkipLast availability).
@coderabbitai

coderabbitai Bot commented Aug 3, 2026

Copy link
Copy Markdown

Important

Review skipped

Auto reviews are limited based on label configuration.

🏷️ Required labels (at least one) (1)
  • state:ready for merge

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro Plus

Run ID: 27643133-c398-4be0-bab4-ca87fdf7992b

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@codecov

codecov Bot commented Aug 3, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 95.45%. Comparing base (4ae3c20) to head (404569b).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #105      +/-   ##
==========================================
+ Coverage   95.36%   95.45%   +0.09%     
==========================================
  Files          93       93              
  Lines        6233     6233              
  Branches     1340     1340              
==========================================
+ Hits         5944     5950       +6     
+ Misses        128      127       -1     
+ Partials      161      156       -5     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@samtrion
samtrion merged commit e4b0a65 into main Aug 3, 2026
12 checks passed
@samtrion
samtrion deleted the feat/analyzer-coverage-improvements branch August 3, 2026 10:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant