Skip to content

GroundedSeek v1.2.0-alpha.1 - Deterministic evaluation

Pre-release
Pre-release

Choose a tag to compare

View all tags
@yuyukosama2004 yuyukosama2004 released this 16 Jul 12:54
v1.2.0-alpha.1
ed252fa
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Eval42 GroundedSeek implementation milestone

This prerelease records the target-project implementation of Eval42 Phase 3:

  • asynchronous adapter over the existing Run and Research Artifact v1 API
  • 15 source-derived candidate cases in the Eval42 v1 protocol
  • frozen search hits, short authored HTML summaries, and deterministic Ollama outputs
  • real workflow, retrieval, storage, citation construction, and URL-safety execution in PR CI
  • Source Domain, Evidence Recall, Citation Validity, and Expected Outcome gates
  • PR report artifacts and an opt-in real-service nightly workflow

Main commit ed252fa passed Windows, Ubuntu 22/24, Debian bookworm/trixie, and frontend CI.

Important boundary

The dataset remains candidate-owner-review and .pending.jsonl; promotion to a human-approved Gold Set is tracked in issue #20. This prerelease does not claim independently verified answer quality. GroundedSeek Core and its existing research queue were not modified.

Assets 2
Loading