Skip to content

Add TraceMatrix for mapping test results to requirements#18

Merged
Malcolmnixon merged 6 commits intomainfrom
copilot/add-support-for-tracematrix
Jan 8, 2026
Merged

Add TraceMatrix for mapping test results to requirements#18
Malcolmnixon merged 6 commits intomainfrom
copilot/add-support-for-tracematrix

Conversation

Copy link
Contributor

Copilot AI commented Jan 8, 2026

TraceMatrix Implementation - Complete ✅

All Requirements Met:

  • Support reading test results using DemaConsulting.TestResults library (v1.2.0)
  • TraceMatrix class built from Requirements and test result files
  • Support for both TRX and JUnit formats with automatic detection
  • Stores execution and pass counts per test
  • Handles matrix testing (multiple executions)
  • Ignores extra tests not in requirements
  • Comprehensive unit tests (10 test methods)
  • All 36 tests passing

Recent Changes:

  • Fixed typo: Renamed requirement ID from "JFAIL-001" to "JUNIT-FAIL-001" to pass spell-checking

Test Results:

All 10 TraceMatrix tests passing, including the updated test with the corrected requirement ID.

Original prompt

This section details on the original issue you should resolve

<issue_title>[Feature]: Add Support for TraceMatrix</issue_title>
<issue_description>### Problem Statement

The project should support identifying which requirement-tests have been tested by tests located in TRX or JUnit test result files.

Proposed Solution

The project should implement the following:

  • Support reading test results using the DemaConsulting.TestResults library
  • Create a TraceMatrix class built from a Requirements class instance and a params array of test result files
  • The test result files should be parsed using the DemaConsulting.TestResults library
  • The TraceMatrix class should store how many times each test was executed and how many passed - this may best be done as a map of test name to TestResult class which holds the counts.
  • Note that tests may be executed multiple times (e.g. matrix testing on different runtimes and operating systems)
  • Note that the test result files may contain extra tests not mentioned in the requirements, and these should be ignored

Appropriate unit tests should be constructed which write test files to temporary folders. The tests should include:

  • TRX and JUnit result files
  • Verifying the expected test counts
  • Verifying extra tests (beyond those in the requirements) are ignored

Alternatives Considered

No response

Additional Context

No response

Priority

High - Blocking current work

Contribution

  • I would be willing to submit a PR for this feature

Code of Conduct

  • I agree to follow this project's Code of Conduct</issue_description>

Comments on the Issue (you are @copilot in this section)


✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.

Copilot AI and others added 3 commits January 8, 2026 04:09
Co-authored-by: Malcolmnixon <1863707+Malcolmnixon@users.noreply.github.com>
Co-authored-by: Malcolmnixon <1863707+Malcolmnixon@users.noreply.github.com>
Co-authored-by: Malcolmnixon <1863707+Malcolmnixon@users.noreply.github.com>
Copilot AI changed the title [WIP] Add support for TraceMatrix in test results Add TraceMatrix for mapping test results to requirements Jan 8, 2026
Copilot AI requested a review from Malcolmnixon January 8, 2026 04:16
@Malcolmnixon
Copy link
Contributor

@copilot A new DemaConsulting.TestResults 1.2.0 has just been released with support for JUnit test results. Please add support for reading test-results in JUnit format - including tests.

Co-authored-by: Malcolmnixon <1863707+Malcolmnixon@users.noreply.github.com>
Copy link
Contributor Author

Copilot AI commented Jan 8, 2026

@copilot A new DemaConsulting.TestResults 1.2.0 has just been released with support for JUnit test results. Please add support for reading test-results in JUnit format - including tests.

Added JUnit support in commit 34aca4c. The TraceMatrix now supports both TRX and JUnit formats with automatic format detection (tries TRX first, falls back to JUnit). Includes 3 new test methods covering JUnit parsing, mixed format files, and JUnit failure tracking. All 36 tests passing.

@Malcolmnixon Malcolmnixon marked this pull request as ready for review January 8, 2026 04:37
Co-authored-by: Malcolmnixon <1863707+Malcolmnixon@users.noreply.github.com>
@Malcolmnixon Malcolmnixon merged commit f16b0cc into main Jan 8, 2026
6 checks passed
@Malcolmnixon Malcolmnixon deleted the copilot/add-support-for-tracematrix branch January 8, 2026 04:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature]: Add Support for TraceMatrix

2 participants