Skip to content

v0.2.0-beta.1

Pre-release
Pre-release

Choose a tag to compare

@github-actions github-actions released this 14 Aug 07:00
f6175ec

Automation Sandbox v0.2.0-beta.1

Preview NuGet package artifact release.

Highlights

  • Locator exception gating (#2): Healing retries are strictly gated to locator-resolution failures rather than blindly retrying arbitrary exceptions.
  • Evidence coverage gate (#3): Signals with missing metadata on both sides (empty names, null parents, zero bounds) are excluded from the denominator so missing data neither penalizes nor produces a false-perfect 1.00 score.
  • Runner-up margin gate (#4): Top candidates with ambiguous margins over the runner-up (best - runnerUp < 0.05) are classified as ambiguous and flagged for manual review instead of falsely marked confident.
  • Intent semantic overlap gate (#5): Desktop and web exploration bridges enforce a minimum semantic score (MinimumSemanticScore = 0.01) and candidate margin, routing semantically unrelated matches to review without persisting them.
  • LLM candidate explainability and divergence tracking (#6): LLM healing results carry the selected candidate's own score and score breakdown, with explicit divergence tracking when the LLM overrides the heuristic winner.
  • Structured assertion generation (#9): Test generators emit structured assertions (AssertionKind, ExpectedValue) with configurable Strict and Lenient modes, replacing false-green presence checks with real assertions.
  • Positioning, Linux CI, and packaging parity (#12, #13, #14): Honest scope positioning in documentation, dual-OS CI matrix across Windows (net48) and Linux (net8.0), and complete packaging parity across all seven libraries.

Known Limitations

  • Calibration: The thresholds shipped in this release are initial estimates, not values derived from a real-world benchmark dataset: MinimumEvidenceWeight (0.40), MinimumCandidateMargin (0.05), MinimumSemanticScore (0.01), and default AssertGenerationMode (Strict). Each is documented with its rationale and is subject to recalibration under #15.
  • Accuracy: Healing accuracy is 100% on the bundled WinForms and WPF demo case studies. The false-positive rate on organic, third-party applications has not been measured (#15).
  • LLM Providers: Provider integrations are covered by mocked-HTTP unit tests, and the Windows CI leg additionally makes a real Gemini call on every run when GEMINI_API_KEY is configured (LlmHealingEvaluationTests, a non-gating comparison harness). What is not covered is a gating live assertion across providers: llm-smoke.yml exercises one OpenAI-compatible endpoint on manual dispatch only, after GitHub Models began returning HTTP 410 ahead of its retirement (#21, #44).
  • Platform: Desktop automation is Windows-only (FlaUI / UIA3). The core heuristic engine and web automation path are cross-platform and verified on Linux in CI (#13).

Packages

  • AutomationSandbox.UiModel
  • AutomationSandbox.SelfHealing
  • AutomationSandbox.LlmHealing
  • AutomationSandbox.Discovery
  • AutomationSandbox.WebDiscovery
  • AutomationSandbox.IntentAutomation
  • AutomationSandbox.PlaywrightLiveExploration

This release publishes package files as GitHub Release assets only. It does not push to nuget.org or GitHub Packages.