v0.2.0-beta.1
Pre-release
Pre-release
Automation Sandbox v0.2.0-beta.1
Preview NuGet package artifact release.
Highlights
- Locator exception gating (#2): Healing retries are strictly gated to locator-resolution failures rather than blindly retrying arbitrary exceptions.
- Evidence coverage gate (#3): Signals with missing metadata on both sides (empty names, null parents, zero bounds) are excluded from the denominator so missing data neither penalizes nor produces a false-perfect 1.00 score.
- Runner-up margin gate (#4): Top candidates with ambiguous margins over the runner-up (
best - runnerUp < 0.05) are classified as ambiguous and flagged for manual review instead of falsely marked confident. - Intent semantic overlap gate (#5): Desktop and web exploration bridges enforce a minimum semantic score (
MinimumSemanticScore = 0.01) and candidate margin, routing semantically unrelated matches to review without persisting them. - LLM candidate explainability and divergence tracking (#6): LLM healing results carry the selected candidate's own score and score breakdown, with explicit divergence tracking when the LLM overrides the heuristic winner.
- Structured assertion generation (#9): Test generators emit structured assertions (
AssertionKind,ExpectedValue) with configurableStrictandLenientmodes, replacing false-green presence checks with real assertions. - Positioning, Linux CI, and packaging parity (#12, #13, #14): Honest scope positioning in documentation, dual-OS CI matrix across Windows (
net48) and Linux (net8.0), and complete packaging parity across all seven libraries.
Known Limitations
- Calibration: The thresholds shipped in this release are initial estimates, not values derived from a real-world benchmark dataset:
MinimumEvidenceWeight(0.40),MinimumCandidateMargin(0.05),MinimumSemanticScore(0.01), and defaultAssertGenerationMode(Strict). Each is documented with its rationale and is subject to recalibration under #15. - Accuracy: Healing accuracy is 100% on the bundled WinForms and WPF demo case studies. The false-positive rate on organic, third-party applications has not been measured (#15).
- LLM Providers: Provider integrations are covered by mocked-HTTP unit tests, and the Windows CI leg additionally makes a real Gemini call on every run when
GEMINI_API_KEYis configured (LlmHealingEvaluationTests, a non-gating comparison harness). What is not covered is a gating live assertion across providers:llm-smoke.ymlexercises one OpenAI-compatible endpoint on manual dispatch only, after GitHub Models began returningHTTP 410ahead of its retirement (#21, #44). - Platform: Desktop automation is Windows-only (FlaUI / UIA3). The core heuristic engine and web automation path are cross-platform and verified on Linux in CI (#13).
Packages
- AutomationSandbox.UiModel
- AutomationSandbox.SelfHealing
- AutomationSandbox.LlmHealing
- AutomationSandbox.Discovery
- AutomationSandbox.WebDiscovery
- AutomationSandbox.IntentAutomation
- AutomationSandbox.PlaywrightLiveExploration
This release publishes package files as GitHub Release assets only. It does not push to nuget.org or GitHub Packages.