Skip to content

Address retry response file review feedback - #10997

Merged
Amaury Levé (Evangelink) merged 3 commits into
microsoft:mainfrom
Evangelink:dev/amauryleve/pr10963-followup-retry-response-files
Sep 3, 2026
Merged

Address retry response file review feedback#10997
Amaury Levé (Evangelink) merged 3 commits into
microsoft:mainfrom
Evangelink:dev/amauryleve/pr10963-followup-retry-response-files

Conversation

@Evangelink

Copy link
Copy Markdown
Member

Follow-up to #10963.

Addresses the remaining response-file review feedback:

  • report the failing nested response file while preserving command-line redaction;
  • keep regenerated response files when literal quotes only occur in the direct argument prefix, and warn when the serialized suffix cannot round-trip safely;
  • centralize generated retry response-file paths;
  • cover multiple original response files and verify generated files are cleaned up after each attempt.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot AI balanced review requested due to automatic review settings September 3, 2026 10:54

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot review overview

🟡 Changes recommended

Key diagnostic, warning, and per-attempt cleanup behavior remains insufficiently verified.

Once you've addressed the issues Copilot identified, you can request another Copilot review.

Review tier: Balanced
Findings: 4 Medium severity

New issues introduced by this change (4)
Severity Finding
Medium severity src/​Platform/​Microsoft.Testing.Extensions.Retry/​RetryOrchestrator.cs — No test exercises this new warning branch. The builder test proves a quoted suffix stays inline,…
Medium severity src/​Platform/​Microsoft.Testing.Platform/​CommandLine/​ResponseFileHelper.cs — The added nested-file tests only exercise FileNotFoundException, so the changed nested…
Medium severity test/​IntegrationTests/​Microsoft.Testing.Platform.Acceptance.IntegrationTests/​RetryFailedTestsTests.cs — This assertion runs only after the entire retry session, so it proves eventual cleanup but not the…
Medium severity test/​UnitTests/​Microsoft.Testing.Platform.UnitTests/​CommandLine/​ResponseFileHelperTests.cs — This test assumes a fixed relative path is absent. If sensitive-nested-path.rsp is left in the…
What changed in this PR

Improves retry response-file diagnostics, regeneration, path management, and cleanup verification.

Changes:

  • Reports nested response-file failures with redaction.
  • Handles quoted prefixes and multiple response files during retries.
  • Centralizes generated paths and cleans files after attempts.
File Description
ResponseFileHelper.cs Tracks nested-file diagnostic paths.
RetryArgumentsBuilder.cs Centralizes paths and refines quote handling.
RetryOrchestrator.cs Warns on unsafe serialization and cleans files.
InternalAPI.Unshipped.txt Tracks new internal helpers.
ResponseFileHelperTests.cs Tests nested-path reporting and redaction.
RetryArgumentsBuilderTests.cs Tests quoted prefixes and multiple files.
RetryFailedTestsTests.cs Checks generated-file cleanup.

💡 Configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

Comment thread src/Platform/Microsoft.Testing.Extensions.Retry/RetryOrchestrator.cs Outdated
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot AI review requested due to automatic review settings September 3, 2026 11:46

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot review overview

🟡 Changes recommended

Nested redaction is lost below the first nested response-file level, potentially exposing a sensitive path.

Once you've addressed the issues Copilot identified, you can request another Copilot review.

Review tier: Balanced
Findings: 1 Medium severity

New issues introduced by this change (1)
Severity Finding
Medium severity src/​Platform/​Microsoft.Testing.Platform/​CommandLine/​ResponseFileHelper.cs — Redaction is lost below the first nested level. For example, if an outer file contains…
Issues resolved since last review (4)
Severity Finding
Medium severity test/​UnitTests/​Microsoft.Testing.Platform.UnitTests/​CommandLine/​ResponseFileHelperTests.cs — This test assumes a fixed relative path is absent. If sensitive-nested-path.rsp is left in the… View resolved comment
Medium severity test/​IntegrationTests/​Microsoft.Testing.Platform.Acceptance.IntegrationTests/​RetryFailedTestsTests.cs — This assertion runs only after the entire retry session, so it proves eventual cleanup but not the… View resolved comment
Medium severity src/​Platform/​Microsoft.Testing.Platform/​CommandLine/​ResponseFileHelper.cs — The added nested-file tests only exercise FileNotFoundException, so the changed nested… View resolved comment
Medium severity src/​Platform/​Microsoft.Testing.Extensions.Retry/​RetryOrchestrator.cs — No test exercises this new warning branch. The builder test proves a quoted suffix stays inline,… View resolved comment

Comment thread src/Platform/Microsoft.Testing.Platform/CommandLine/ResponseFileHelper.cs Outdated
@Evangelink Amaury Levé (Evangelink) added the state/needs-review Awaiting review from the team. label Sep 3, 2026
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot AI review requested due to automatic review settings September 3, 2026 13:58

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot review overview

🟢 Approval recommended

The implementation addresses the stated feedback with focused regression coverage and no unresolved issues.

Review tier: Balanced
Findings: None

Issues resolved since last review (1)
Severity Finding
Medium severity src/​Platform/​Microsoft.Testing.Platform/​CommandLine/​ResponseFileHelper.cs — Redaction is lost below the first nested level. For example, if an outer file contains… View resolved comment

@Evangelink
Amaury Levé (Evangelink) merged commit ad89b34 into microsoft:main Sep 3, 2026
47 checks passed
@Evangelink
Amaury Levé (Evangelink) deleted the dev/amauryleve/pr10963-followup-retry-response-files branch September 3, 2026 16:26
Amaury Levé (Evangelink) added a commit that referenced this pull request Sep 4, 2026
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 76b97bb3-f245-4966-ad27-455c0aff2d79
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

state/needs-review Awaiting review from the team.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants