Repository navigation
Added
tracta baseline --questions FILEcreates a watch that asks your own questions from a JSON Lines file (one{"id", "prompt"}per line; example:docs/questions-example.jsonl) instead of the built-in 436. The watch keeps a copy inquestions.json,statusshows the question count and source, and the report says the built-in evidence figures do not apply. Harder questions near the edge of what your model knows give more power against strong models. Go binary only.
Tested
- The Windows amd64 binary of 0.2.0 passed the four end-to-end cases on a Windows laptop against a remote llama-server. The 0.3.0 macOS arm64 binary passed the four built-in cases and a 60-question run with its own file. The Linux, Intel macOS and 0.3.0 Windows builds were not run.
Verify a download: shasum -a 256 -c SHA256SUMS --ignore-missing
Full changes: v0.2.0...v0.3.0