Skip to content

Releases

quelltest v0.3.1

Choose a tag to compare

@shashankbindal shashankbindal released this 20 Oct 18:09
2066bec

Fixes from the 0.3.0 effectiveness report, and a research-backed answer to code that depends on API calls and services (see docs/dependencies.md).

Added

  • generate: property guards (typeof body.lat !== "number", !branch.geofences?.length) become tests with a composed argument.
  • generate: path-condition stub synthesis for injected dependencies (parameters, their methods, global fetch): the guards on a call's result define the conditions, a small solver picks the values, and the first guard to fire decides the expected outcome. Stubs are labelled as derived from guards, not from the real service. A stubbed globalThis.fetch is always restored.
  • Rules unguarded-network-call and deep-response-chain; inline literal secrets in jwt.sign/createHmac; the plain missing-await form.
  • verify: survivors on mocked code carry mockBoundary and an explanation in the handoff; --command runs your own integration command (Testcontainers, in-memory server) against every mutant; --timeout; mutants capped per kind (maxPerKind, default 8).
  • quell mocks --examples FILE: checks stubs annotated // quell-mock GET /path against recorded examples (HAR, JSON map, OpenAPI JSON).
  • quell eval and the eval/ fixtures ship in the package; findings carry confidence and --min-confidence filters them.

Fixed

  • module.exports.name = fn, exports.name, bracket form and Object.assign(module.exports, ...) are recognised as exports.
  • Route request cases see through asyncHandler(...), catchAsync(...), wrap(...), middleware chains and curried wrappers.
  • gate reports a newly added .only and shows a deleted-and-rewritten test as a replacement.
  • A sanitiser applied through a variable (const p = escapeRegex(q)) no longer triggers regex-injection; a redirect checked with startsWith('/') is not an open redirect.
  • From the independent review of this release: generation for if (!body) ...; if (body.lat > 90) ... composes an object root instead of true; the security gate allows globalThis.fetch only as an assignment target or as const originalFetch = globalThis.fetch (never called or aliased); prototype-walking member names (__proto__, constructor, prototype) are rejected so the process cannot be polluted; guards nested in else-branches, loops or other conditions, tests of reassigned parameters and functions that call the network without a stubbable result are refused with a reason; a stubbed parameter that is also guarded keeps its guard cases; duplicate local result names are ambiguous; an imported or local fetch is not the global one; --command passes the test path in an environment variable (no shell interpolation) and --infra-exit marks environment-failure exit codes; missing-await needs a Model-like receiver or an ORM in the module and ignores Array.find; a redirect needs both startsWith('/') and startsWith('//') checks; only a try block (not catch/finally or detached callbacks) guards a call; gate pairing does renames first and ignores generic names; computed export keys are skipped; quell mocks escapes routes, avoids backtracking and survives malformed example files.
  • A verification mirror that cannot be deleted (a child process still holds it after a timeout) no longer fails the run.

Install: npm install quelltest@0.3.1 (https://www.npmjs.com/package/quelltest/v/0.3.1)

quelltest v0.3.0

Choose a tag to compare

@shashankbindal shashankbindal released this 20 Oct 17:42
5b18e4a

Repositioned as the free, offline gate for AI-written tests (see docs/agents.md).

Added

  • quell gate --diff REF: detects deleted/skipped tests, .only, removed and loosened assertions and changed expected values in a change; --json, --sarif, --strict; exit code 5. // quell-allow-weaken exempts a test.
  • quell mcp: MCP server on stdio with find, verify and gate tools.
  • verify: survivor handoff report (--handoff FILE), --min-score, --findings, --in-place, // quell-ignore-mutant, relative path support, the failing command in error messages.
  • Risk-aimed mutants: sanitiser unwrap, await removal, ??/|| swaps, ordered ahead of generic operator flips.
  • Rules: nosql-injection, path-traversal, open-redirect, missing-await, hard-coded-secret, eval-input, unparsed-json; one hop of data flow from req.body/query/params (aliasing, spread, $set, destructuring, JSON.parse, new URL).
  • // quell-ignore [rule] and // quell-ignore-file.
  • generate: request cases for Express route handlers in TODO notes, actionable reasons (export / extract / unsupported expression), skips candidates already covered (--include-covered overrides).
  • Verifier benchmark (eval/gate), runner fixture matrix for Jest, Mocha, Vitest and node:test.

Changed

  • verify and generate --verify run in a temporary copy of the project by default; the real source is never written (falls back to in-place with a backup for very large projects).
  • Findings are ranked by per-rule risk; falsy-fallback fires only for numeric defaults; nullish ignores code that already has a fallback or guard; unguarded-call respects asyncHandler-style wrappers.
  • README rewritten around the verifier; honest comparison with Stryker, Flawd and LLM generators.

Fixed (from the independent review of this release)

  • Verification can no longer write through a symlinked source file; sources under build//dist/ are mirrored; mutants that do not parse are dropped instead of counted as kills; return await and plain coercions are no longer prioritised equivalent mutants; refuses to overwrite an existing test in place; warns when it falls back to in-place.
  • Scanner: per-sink sanitisers, whole-body vs single-field taint, reassignment and parameter shadowing, same-site redirects, route/i18n constants, process.env defaults; quell-ignore-mutant no longer suppresses scanner findings.
  • Gate: git renames, describe.only, template-literal and repeated test names, expect.assertions/t.mock/t.plan no longer counted, unparsable files are errors; the PR workflow's gate step now fails the job.
  • MCP: malformed messages, batches and stray responses are handled without crashing.
  • Nothing in 0.2.0's behaviour was removed. New exit codes: 4 (verify not verified, 0.2.0) and 5 (gate).

Install: npm install quelltest@0.3.0 (npm). Later fixes are in the changelog.

quelltest v0.2.0

Choose a tag to compare

@shashankbindal shashankbindal released this 20 Oct 17:36
35b7c5c

AST scanner, coverage-based score, mutation-based verification, real test generation for the detected runner, --diff, SARIF, --llm hook, Apache-2.0 licence.

Install: npm install quelltest@0.2.0 (npm). See CHANGELOG.md for later releases.

quelltest v0.1.0

Choose a tag to compare

@shashankbindal shashankbindal released this 20 Oct 17:42

First release: regex scanner, placeholder scaffolds.

Install: npm install quelltest@0.1.0 (npm). Superseded: this version generated placeholder tests and a score that could not move; use 0.2.0 or later.