Skip to content

v0.2.0 — Evidence-first neural search lab

Choose a tag to compare

View all tags
@Madhvansh Madhvansh released this 18 Jul 20:04
v0.2.0
eb9d683
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Neural E-Commerce Search v0.2.0

This is an evidence-first reset of the public project.

Try it

  • Run the no-login browser lab

  • Run the dependency-light contract demo after installing the wheel:

    necs-demo --query "wireless gaming mouse" --top-k 6

The browser lab performs real client-side dense retrieval using Transformers.js
3.8.1 and pinned all-MiniLM-L6-v2 revision 751bff3. It uses a synthetic
catalogue and is not the repository's unreleased ESCI-trained pipeline or
benchmark evidence.

Integrity and evaluator repairs

  • Withdraws historical learned metrics that lacked a complete, reproducible
    result bundle.
  • Separates official ESCI Task 1 ranking (small_version) from Task 2
    classification (large_version).
  • Requires dense retrieval before reranking and evaluates the returned set.
  • Computes ideal DCG from complete qrels and counts missing queries as zero.
  • Rejects duplicate and unjudged Task 1 result IDs instead of allowing inflated
    metrics.
  • Rejects mismatched classification truth/prediction lengths.
  • Uses only query-specific judged S/C/I hard negatives.
  • Propagates the warmed checkpoint through mining, the second training pass, and
    index construction.

Packaging and contributor surface

  • Adds an installable necs-demo CLI and bundled synthetic catalogue.
  • Builds and installs the wheel in a clean environment in CI.
  • Adds evidence, reproducibility, release, contribution, support, security,
    citation, and issue-form guidance.
  • Adds a machine-readable schema for future result bundles.

Verification

  • 57 lightweight Python tests pass locally.
  • Public CI passes on Python 3.9 and 3.11.
  • The package-smoke job builds the distribution, installs the wheel in a clean
    environment, and runs the CLI.
  • Browser ranking/DOM-contract smoke and JavaScript syntax checks pass.
  • A public fresh-cache neural query completed successfully; a cached repeat
    completed in single-digit milliseconds on the verification client.

Current limitations

No current learned ESCI benchmark number is published. ESCI-trained project
weights, a hosted full retrieve-rerank service, raw multi-seed predictions, and
a complete result bundle remain future work. See
EVIDENCE.md
before citing or extending results.

Assets 5
Loading