Skip to content

Add AI-driven game validation and graphics diagnostics - #69

Merged
Pursche merged 3 commits into
masterfrom
pursche/AITooling
Jul 27, 2026
Merged

Add AI-driven game validation and graphics diagnostics#69
Pursche merged 3 commits into
masterfrom
pursche/AITooling

Conversation

@Pursche

@Pursche Pursche commented Jul 27, 2026

Copy link
Copy Markdown
Contributor

Summary

Adds the Game-side automation and diagnostics required for Codex or Claude Code to run deterministic validation workloads through MCPTools.

Changes

  • Add the restricted automation_run console command for executing Luau scripts from the configured automation root.
  • Emit request-scoped automation and artifact lifecycle markers through the process log.
  • Add Luau APIs for:
    • Scheduling callbacks after a duration or number of frames.
    • Discovering and loading maps and camera saves.
    • Inspecting and changing CVARs.
    • Dumping named render targets to PNG files.
    • Taking opt-in RenderDoc captures.
    • Controlling and annotating Tracy captures.
  • Add game-ready, map-loaded, and map-load-failed events for deterministic asynchronous workloads.
  • Add retained validation sequences for:
    • Fast representative map coverage.
    • Loading every available map.
    • Sweeping finite CVAR values and restoring their original state.
    • Render-target and RenderDoc capture smoke tests.
  • Add automation documentation and an AI validation runbook.
  • Add unit coverage for automation path handling, scripting APIs, render-target capture, and RenderDoc capture.
  • Keep RenderDoc disabled unless Game is launched with -renderdoc; the capture object and DLL are not loaded otherwise.
  • Fix SVSM dynamic shadow handling by:
    • Removing the per-caster dynamic page-marking limit.
    • Increasing the default dynamic shadow pool from 2048 to 3072.
    • Keeping live pool-size edits pending until restart while continuing to use the allocated pool dimensions.

Validation

The retained scripts provide deterministic workloads for the three supported Vulkan validation modes:

  • Core validation
  • Synchronization validation
  • GPU-assisted validation

Generated reports and capture artifacts are written to ignored directories rather than committed to source control.

Pursche added 3 commits July 27, 2026 20:12
Add support for running automation scripts for validation runs and testing
Add console command to launch the automation scripts
Add automation script for validating all maps (light/full)
Add automation script for toggling all CVARs
Add automation script for validating renderdoc
Add automation script for validating rendertarget dump to file
Add Tracy support to automation scripts
Fix some map loading event issues
Remove cap of how many pages a single dynamic shadow caster can touch
Increase dynamic shadow pool size from 256 pages to 576
@Pursche
Pursche merged commit d4dd9fe into master Jul 27, 2026
1 check failed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant