Conversation
…omains and strict mode id Agent-Logs-Url: https://github.com/github/gh-aw/sessions/50a2f766-6b68-4657-b923-e82ffbbd398a Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
There was a problem hiding this comment.
Pull request overview
Updates TestFirewallArgsIntegration to match recent compiler/AWF behavior changes so CI integration tests pass again.
Changes:
- Updates assertions to check for
allowDomainsin the embedded AWF config JSON instead of the legacy--allow-domainsCLI flag. - Updates the “old AWF version” workflow fixture to include
sandbox.agent.idto satisfy strict-mode validation.
Show a summary per file
| File | Description |
|---|---|
| pkg/workflow/firewall_args_integration_test.go | Aligns integration test expectations/fixtures with the config-file migration and strict-mode sandbox.agent.id requirement. |
Copilot's findings
Tip
Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
Comments suppressed due to low confidence (1)
pkg/workflow/firewall_args_integration_test.go:156
- Same as above: consider asserting on the quoted JSON key
"allowDomains"instead of the unquoted substring to match existing integration-test patterns (e.g., pkg/workflow/blocked_domains_integration_test.go:83) and avoid accidental matches.
if !strings.Contains(lockYAML, "allowDomains") {
t.Error("Compiled workflow should contain 'allowDomains' in the AWF config JSON")
- Files reviewed: 1/1 changed files
- Comments generated: 1
| if !strings.Contains(lockYAML, "allowDomains") { | ||
| t.Error("Compiled workflow should still contain 'allowDomains' in the AWF config JSON") |
🧪 Test Quality Sentinel ReportTest Quality Score: 100/100✅ Excellent test quality
Test Classification Details
What ChangedThis PR makes three targeted corrections to an existing integration test file:
All three changes update tests to match actual production behavior — this is exactly the right kind of maintenance work. Verdict
📖 Understanding Test ClassificationsDesign Tests (High Value) verify what the system does:
Implementation Tests (Low Value) verify how the system does it:
Goal: Shift toward tests that describe the system's behavioral contract — the promises it makes to its users and collaborators. Language SupportTests analyzed:
References: §25250703916
|
TestFirewallArgsIntegrationwas failing in CI due to two separate behavioural changes that landed without updating the integration tests.Changes
--allow-domainsmoved to JSON config file:BuildAWFConfigJSONnow writes network egress rules as"allowDomains"in a structured JSON config rather than passing--allow-domainsas a CLI flag. Two test assertions were still checking for the old CLI flag string:Strict mode requires explicit
sandbox.agent.id:validateStrictSandboxCustomizationnow rejects asandbox.agentblock with noidfield in strict mode (the default). Theworkflow_pinning_old_AWF_version_does_not_emit_--exclude-envtest workflow usedsandbox.agent.versionalone, causing compilation to fail before the assertion was ever reached. Addedid: awfto the fixture: