Repository navigation
Focus Review 2026 11 20
By 1.7 QASight had about 40 commands, four ways in (CLI, web UI, REST API, MCP) and two promises side by side: track your tests, and grade your code per release. Taltal worried it read as "AI slop". The features were real and tested; what made it look scattered was that everything sat at the same height. qasight --help listed 37 commands in five panels, 20 of them under "Run and report"; the README's "What's new" listed about 30 features in one paragraph; the Overview showed two scores and seven cards.
QASight is CLI-first and mostly driven by coding agents (see CLI-Only Bug Hunt - 2026-11-15), and Taltal values versatility, so the rule was to hide and make optional rather than delete.
One promise: "Every test run, remembered. After a red build, know in a minute what's new, what's flaky and what got slower, from your terminal, your CI or your coding agent." It leads the README, qasight --help and the Overview.
Three rings. Core is what answers the promise and is shown first. Optional stays in the product, documented, and off or out of sight until it is set up. Removal is rare and goes through the Stability and Deprecation Policy.
| Surface | Change |
|---|---|
| CLI |
qasight --help shows ten commands in Start (init, demo, doctor), Record (run, ingest), Understand (summary, flaky, ui) and Share (ci, mcp). The rest are hidden from that page only: qasight help --all lists them under "More:" panels, and qasight help --json describes every command, alias and exit code for agents. try, pool and config-db become ci preview, lease pools and config db; the old names stay as aliases (not deprecated). version is unlisted (--version). See Command Reference. |
| README | 395 lines to about 110: the promise, one screenshot, three commands to start, a table of the three questions, the Action, and one table of optional features. The API table moved to the Architecture Overview, local development to CONTRIBUTING.md, the v1.0 migration to the deprecation policy, release notes stay in CHANGELOG.md. |
| Overview | Needs attention and the latest run open the page; Test health is the one score, Code quality appears once a scorecard has run. Delivery numbers stay on the Report page. Ask shows in the menu once an AI provider is set up, Resources once a pool exists (both still reachable by URL). Since Merge and Automate, Resources is a tab of Settings and Test health opens inside the Overview. |
| Removal | The InfluxDB and Prometheus Pushgateway push is deprecated (OpenTelemetry covers it) and goes in 2.0. |
The code quality scorecard and release gate are an optional module, not half of the identity: they keep every feature, and leave the first screen and the main help.
Not done here: PR #340 was open during this review. Its qasight case-study and triage accuracy commands are development tools and belong in scripts/ or under help --all, not in the core help; that is decided on #340 itself. export-site and badge stay top-level commands under "More: reports and alerts" instead of moving under export, which would change how export parses its arguments.
- A new command or page has to say which ring it belongs to. Only something that helps answer "what's new, what's flaky, what got slower" goes in the core help, the README's first half or the Overview.
- Hidden commands are not offered by shell completion; they run exactly as before, and
qasight help --alllists them. - Scripts and agents that read
qasight --helpsee fewer commands;qasight help --jsonis the full, stable list. - The review itself (in Hebrew) is in the project's files,
focus-review/qasight-focus-review-2026-11-19.md.
Generated from docs/Specs & ADRs/Focus Review - 2026-11-20.md. Edit it there; changes made in the wiki are overwritten.
Architecture
CLI Commands
Processes & Guides
- CI-CD Pipeline Setup
- Closed Network Install
- E2E Harness Operations Guide
- GitLab Pages Demo
- Publishing Docker Images
- Publishing to Artifactory
- Publishing to PyPI
- Setup Snippets
- Shared Resource Pools
- Stability and Deprecation Policy
- Team Server
- Upload Without Python
Prompts & Snippets
Roadmap & Strategy
- Feature Gaps and Quick Wins - 2026-10-31
- New User Journey Audit - 2026-11-01
- Paid Features to Offer Free - 2026-10-31
- Product Roadmap
Specs & ADRs
- Adoption Blockers - 2026-11-12
- Affected Test Selection - 2026-10-30
- Alerts Where Developers Look - 2026-10-22
- Architecture Consolidation - 2026-10-06
- Architecture Review - 2026-10-31
- Automation and Unification - 2026-11-12
- BehaveX Reports - 2026-10-21
- Better Flaky Signal - 2026-11-01
- CLI-Only Bug Hunt - 2026-11-15
- Closed Network Install - 2026-11-15
- Closed-Network Monorepo Rollout - 2026-11-20
- Command Adapter and JUnit Import - 2026-09-25
- Config JSON Schema - 2026-10-22
- Crash Detection - 2026-10-31
- Delta Comparison Policy
- Docs Site - 2026-10-19
- Docs Vault and Wiki Sync - 2026-10-07
- Easy Setup - 2026-11-01
- Engine Fixes - 2026-11-01
- Engineering Health Review - 2026-10-31
- Exporting Results - 2026-11-01
- External Audit Tools - 2026-11-11
- Flaky Test Issues - 2026-11-01
- Flaky Test Quarantine - 2026-10-22
- Focus Review - 2026-11-20
- Free Copies of Paid Features - 2026-11-01
- GitHub Action PR Comment - 2026-10-19
- Go Uploader - 2026-11-20
- Human-Run Resource Provider - 2026-10-30
- Importer and Integration Bug Hunt - 2026-10-31
- Ingest and Team Server - 2026-10-22
- Interview Readiness Fixes - 2026-10-07
- Library Packaging
- Lifecycle Fixes - 2026-11-02
- MCP Server - 2026-11-01
- Menu by Question - 2026-11-12
- Merge and Automate - 2026-11-20
- New User Journey Automation - 2026-11-01
- Open Source Features - 2026-10-19
- OpenTelemetry Export - 2026-10-30
- Phase 3 Delta Comparison Engine Plan
- Phase 3 Unified Dashboard Plan
- Phase 4 BYOK and Failure Analysis
- Phase 5 UI Redesign - Cycles-First Navigation
- Playwright Adapter - 2026-10-19
- Playwright JSON Import - 2026-10-22
- Plug and Play - 2026-11-12
- Plugin API - 2026-10-19
- Product Roadmap Work - 2026-10-25
- Product to Ten - 2026-10-25
- Project Health - 2026-10-26
- QASight Logo - 2026-11-05
- Qualflare Follow-ups - 2026-10-26
- Quarantine From the UI - 2026-11-01
- Specs & ADRs
- Release Gate - 2026-11-12
- Release Scorecard - 2026-11-12
- Rename to QASight - 2026-11-04
- Repository Pattern - Database-Agnostic Refactor
- Resource Lifecycle Hooks - 2026-10-26
- Resource Pools and Leases - 2026-10-26
- Run Deletion and Stop - 2026-11-02
- Runner Coverage - 2026-10-26
- Scale Runs and Stages - 2026-10-24
- Scorecard on MegaLinter - 2026-11-12
- Security and Install Review - 2026-10-31
- Standards Compliance - 2026-11-12
- Switchable Team Features - 2026-10-24
- Test Delivery Metrics - 2026-11-02
- Test Labels, Environments and Releases - 2026-11-02
- Test Source in AI Summaries - 2026-11-01
- Throwaway Stage Containers - 2026-10-24
- Tidy Cards and Demo Examples - 2026-11-05
- UI Design Review - 2026-10-31
- UI Polish - 2026-11-08
- UI Restyle - 2026-10-19
- UI Review Fixes - 2026-11-01
Testing Workflows
Vault