Fix TestResults-IO review-set structure and add IOTests.cs subsystem test suite#136
Conversation
Agent-Logs-Url: https://github.com/demaconsulting/TestResults/sessions/b6865e9a-9603-4d3e-9659-a6ee0810bda7 Co-authored-by: Malcolmnixon <1863707+Malcolmnixon@users.noreply.github.com>
|
@copilot Hold on - the TestResults-IO review-set is ENORMOUS. I gave you clear instructions on what's supposed to be in a review-set:
TestResults-IO is a subsystem so it's only supposed to have THREE items:
Every subsystem is supposed to have a test suite - a specific subsyste test-suite whose job is to have tests proving the subsystem works - that's separate from the unit test-suites - and those tests will end up utilizing one or more of the units and possibly having tests that look similar to unit tests, but that's how it's supposed to work. A subsystem is supposed to be reviewable to show it works without having to dive in to all its units. This is a mitigation for agent LLM context windows. |
…s.cs Agent-Logs-Url: https://github.com/demaconsulting/TestResults/sessions/457c5463-340b-446c-987a-103d91cb5b8b Co-authored-by: Malcolmnixon <1863707+Malcolmnixon@users.noreply.github.com>
Fixed in 6988e61. |
There was a problem hiding this comment.
Pull request overview
Updates the repository’s ReviewMark configuration for the TestResults-IO subsystem to align review-set grouping with the intended subsystem/unit boundaries, and introduces a new end-to-end IO subsystem test suite.
Changes:
- Trimmed
TestResults-IOreview-set to subsystem-level artifacts (reqs/design/test suite) and removed unit-level files from that subsystem review-set. - Added
test/DemaConsulting.TestResults.Tests/IO/IOTests.csas the IO subsystem end-to-end test suite (Identify + Deserialize for TRX and JUnit). - Added
TestHelpers.csinto the relevant unit review-sets that depend on it.
Reviewed changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated 1 comment.
| File | Description |
|---|---|
test/DemaConsulting.TestResults.Tests/IO/IOTests.cs |
Adds subsystem-level end-to-end tests covering format identification and deserialization for TRX and JUnit. |
.reviewmark.yaml |
Restructures TestResults-IO to subsystem scope and updates unit review-sets to include shared TestHelpers.cs where used. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
Pull Request
Description
Corrects the structure of the
.reviewmark.yamlreview-sets to follow the required pattern where each review-set contains exactly three items: requirements, design, and test suite.TestResults-IOsubsystem review-set was over-populated with all unit-level files. It has been trimmed to the correct three subsystem-level items:docs/reqstream/test-results/io/io.yaml— subsystem requirementsdocs/design/test-results/io/io.md— subsystem designtest/DemaConsulting.TestResults.Tests/IO/IOTests.cs— subsystem test suiteIOTests.cshas been created as the IO subsystem test suite. It exercises the subsystem's public API (Serializer.IdentifyandSerializer.Deserialize) end-to-end for both TRX and JUnit formats, proving the subsystem works without diving into individual unit internals.Unit review-sets (
TestResults-IO-Serializer,TestResults-IO-TrxSerializer) have hadTestHelpers.csadded since those units' test suites use it:TestResults-IO-Serializer: addedTestHelpers.cs(used bySerializerTests.cs)TestResults-IO-TrxSerializer: addedTestHelpers.cs(used byTrxExampleTests.cs)TestResults-IO-JUnitSerializer: unchanged —JUnitSerializerTests.csdoes not useTestHelpers.csType of Change
Related Issues
Pre-Submission Checklist
Before submitting this pull request, ensure you have completed the following:
Build and Test
dotnet build --configuration Releasedotnet test --configuration ReleaseCode Quality
dotnet format --verify-no-changesQuality Checks
Please run the following checks before submitting:
./lint.sh(Unix/macOS) orcmd /c lint.bat/./lint.bat(Windows)Testing
Documentation
Additional Notes
Changes to
.reviewmark.yamland the addition ofIOTests.cs. No source library or documentation changes.