docs(ui): document the backtest/calibration system as a fumadocs page#8153
Merged
Conversation
…#8114) #8138 (threshold backtest, shipped ORB-native in #8142) and #8139 (logic backtest CI check, shipped in #8147) are exactly the #3047 failure shape -- new CLI flags, a new CI check with its own trigger/comment behavior, a gate-adjacent pending policy decision (#8105) -- with no docs. Adds content/docs/backtest-calibration.mdx (corpus model, the two backtest mechanisms and why they run where they run, how to read the Pareto-floor comparison, secret_leak's permanent exclusion, the track-record/corpus-export CLIs, and the advisory-only guarantee with #8105 noted as pending) plus the thin route, nav/command-palette entries, and the regenerated route tree. The two pinned docs-route-count tests move 48 -> 49.
Contributor
|
Superagent didn't find any vulnerabilities or security issues in this PR. |
Deploying with
|
| Status | Name | Latest Commit | Preview URL | Updated (UTC) |
|---|---|---|---|---|
| ✅ Deployment successful! View logs |
loopover-ui | 53f1030 | Commit Preview URL Branch Preview URL |
Jul 23 2026, 06:17 AM |
Bundle ReportChanges will increase total bundle size by 16.24kB (0.22%) ⬆️. This is within the configured threshold ✅ Detailed changes
Affected Assets, Files, and Routes:view changes for bundle: loopover-uiAssets Changed:
|
loopover-orb
Bot
added
the
gittensor:bug
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
content/docs/backtest-calibration.mdx(fumadocs entry, standard frontmatter) covers: the labeled corpus model (fired + human-override history), the two backtest mechanisms and why they run where they run (threshold = no code execution, lives in the Worker's unified comment; logic = executes the PR's own code, so it lives in CI and posts its own comment), how to read the Pareto-floor comparison ("reversed" as positive class, N/A-never-zero, any-regressed-axis ⇒ REGRESSED), the pre-Extend the backtest check to logic/regex changes via a dedicated CI job, using captured raw context #8139 skipped-cases rule,secret_leak's permanent exclusion and its reason, the read-only track-record/corpus-export CLIs, and the advisory-only guarantee with the Decide + implement whether a REGRESSED backtest verdict should ever gate a merge (Phase 2) #8105 gating decision explicitly noted as pending.docs.backtest-calibration.tsxmirrorsdocs.ai-summaries.tsxexactly (getDocPage loader, head/og meta, DocsPage + Suspense/LoadingState). Nav entries added indocs-nav.tsx(Core concepts),docs.index.tsx(Maintainers card), andcommand-palette.tsx; route tree regenerated; the two pinned docs-route-count tests move 48 → 49.Closes #8114
Scope
type(scope): short summaryConventional Commit format, for examplefix(api): restore profile access checks.CONTRIBUTING.mdand does not reintroduce GitHub Pages, VitePress,site/, orCNAME.Closes #123) — a linked open issue is required for every contributor PR.Validation
git diff --checknpm run actionlintnpm run typechecknpm run test:coveragelocally;codecov/patchrequires ≥99% coverage of the lines AND branches you changed (aim for 100% on your diff so CI variance does not fail near the threshold). Global coverage is a non-blocking trend with a loose 90% backstop, not the gate.npm run test:workersnpm run build:mcpnpm run test:mcp-packnpm run ui:openapi:checknpm run ui:lintnpm run ui:typechecknpm run ui:testnpm run ui:buildnpm audit --audit-level=moderateIf any required check was skipped, explain why:
npm run test:cion this branch was green through every step exceptui:version-audit, which failed on the pre-chore(ui): sync MCP_PACKAGE_KNOWN_LATEST_VERSION with npm dist-tags.latest #8149 fork point (npm published @loopover/mcp 3.4.0 mid-session; main fixed the pinned copy in chore(ui): sync MCP_PACKAGE_KNOWN_LATEST_VERSION with npm dist-tags.latest #8149). After rebasing onto that fix:ui:version-auditand every remaining step (manifest/engine-parity/nvmrc/release-manifest/command-referencedrift checks, plusui:lint/ui:typecheck/ui:test/ui:build) re-ran green individually. All touched paths are underapps/**(outside coverage.include), so Codecov imposes nothing; the docs-route policy suites (server-isolation, loading-state, eager-scope) cover the new page, and the vite build compiled the MDX end-to-end.Safety
UI Evidencesection below with JPG/JPEG or PNG screenshots arranged as organized, captioned, clickable thumbnails. SVG screenshots are not used as review evidence. Review-only screenshots or recordings are not committed to the repository.UI Evidence
Deliberately omitted (maintainer PR): the page is pure MDX rendered through the exact
DocsPagetemplate all 48 existing docs pages use — no new visual surface, no layout change. Preview locally withnpm --prefix apps/loopover-ui run dev→/docs/backtest-calibration.Notes
docs.*.tsxthin routes with one dynamicdocs.$slug.tsx(this PR adds route chore(deps): bump zod from 3.25.76 to 4.4.3 #49 the old way deliberately — consistency first, consolidation as its own change).