Skip to content

Add golden regression store and coverage-aware validation#24

Merged
DevOpsMadDog merged 2 commits into
mainfrom
codex/implement-golden-regression-dataset-loader-2id69q
Oct 4, 2025
Merged

Add golden regression store and coverage-aware validation#24
DevOpsMadDog merged 2 commits into
mainfrom
codex/implement-golden-regression-dataset-loader-2id69q

Conversation

@DevOpsMadDog
Copy link
Copy Markdown
Owner

Summary

  • add a golden regression data store for loading and matching historical cases
  • integrate the decision engine with the store to return coverage-aware regression validation details
  • seed historical regression cases and add focused tests that exercise pass/fail/no-coverage paths

Testing

  • pytest tests/test_golden_regression.py

https://chatgpt.com/codex/tasks/task_e_68df1ed639848329924e3bced93280b5

@DevOpsMadDog DevOpsMadDog merged commit 705fbd6 into main Oct 4, 2025
DevOpsMadDog added a commit that referenced this pull request Apr 28, 2026
…al fallback

- JamfConnector: Classic API computers + mobiledevices XML endpoints
- Generates findings: unmanaged device (high), stale check-in >7d (medium),
  outdated macOS <13 or iOS <16 (medium), unsupervised iOS (low)
- Auth: bearer token (JAMF_API_KEY) or Basic (JAMF_USERNAME+PASSWORD)
- Graceful needs_credentials no-op when JAMF_BASE_URL absent
- 1-hour result cache; idempotent via correlation_key=jamf_device|{serial}|{type}
- Wires /api/v1/mdm/devices (triage item #24)
- 4 tests: missing-creds, mock-XML-parse+findings, live (skipif), findings logic

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
DevOpsMadDog added a commit that referenced this pull request May 1, 2026
…m/devices — close type-a empty endpoint

Triage item #24 (NEEDS-CONNECTOR). Adds list_devices_with_mdm_fallback() to MDMEngine: when an org has zero enrolled devices, both IntuneConnector and JamfConnector are invoked. Whichever returns devices is projected into the MDM device shape (tagged source="intune"/"jamf"); rows are deduped by device_id. Platform filter applies to derived rows; needs_credentials returns structured empty + hint when both connectors lack creds, never mock data.

Intune projection collapses multiple findings per device on correlation_key stem; severity → compliance_status; title heuristic infers platform. Jamf projection maps managed=false → non_compliant; raw fields → MDM device shape.

Router /api/v1/mdm/devices now uses the fallback method. 7 new tests cover: needs_credentials, jamf-only, intune-with-dedup, org_enrolled precedence, platform filter, exception isolation, both-zero-devices.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
DevOpsMadDog added a commit that referenced this pull request May 1, 2026
…+Jamf) DONE in triage doc

Backlog 10 closes 2 type-a endpoints. Class (a) tally: 10 → 8 deferred.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
DevOpsMadDog added a commit that referenced this pull request May 5, 2026
… at HEAD 2c72e3a

Suite 1 Beast Mode 13 files: 753 passed, 0 failed in 8.63s
Suite 2 Perf -m perf: 194 passed, 2 skipped, 0 failed in 26.28s
Suite 3 OWASP -m owasp: 47 passed, 2 skipped, 0 failed in 17.86s
Suite 4 Lockdown (asyncio + coroutines): 11 passed, 0 failed in 6.50s
Total: 1005 passed, 0 failed, 4 skipped, 0 broken collectors
Commits validated since sweep #23: 9945b72, 2c72e3a (doc-only)
CERTIFICATION: ALL GREEN

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
DevOpsMadDog added a commit that referenced this pull request May 5, 2026
…oulder stop

Append Closing Note v16: 1005-pass certification across all 4 lockdown suites (Beast Mode 753, Perf 194, OWASP 47, asyncio+coroutines lockdown 11). 24 sweeps, 10 real bugs caught + closed, 0 shipped.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant