Repository navigation
v0.4.8
A text that cites nothing can now be checked: proofpath searches the web for it. And
the judge no longer goes quiet when Groq's free tier runs out.
Added
- Evidence search for claims with no source (experimental). A pasted post or plain
text with no link, no[12]marker and no bibliography used to end in a parse error.
Withsearch.providerset totavily(a free key inTAVILY_API_KEY) orsearxng
(plussearch.base_url), up to 5 check-worthy sentences are searched, up to 3 pages
each. Every page is fetched and read like any other source; the search result's own
snippet is never evidence. Findings are markedFOUND BY PROOFPATH (not cited by the author):SUPPORTED/REFUTED (found by proofpath)carry their passage, and a claim
nothing confirmed isNO EVIDENCE FOUND (searched), neverREFUTED. Setting the
provider is the consent;--no-searchturns it off for one run and
permissions.web_search = denyfor good. A run that searched only some of its
check-worthy claims says so and exits 1. AVeriTeC search mode scores 0.404
against a 0.708 majority baseline, which is why it is marked experimental. - Queries and translation by the judge. With
--judge, the model writes the search
queries and translates a non-English claim; the report shows your sentence and a
checked as: …line. Without a judge, a claim that is not in English is
UNVERIFIED (language not supported)rather than checked by English-only models. - Local fallback judge. When Groq hits its rate limit, rejects the key or stops
answering, the run switches at once toqwen3.5:9bin your local Ollama, if it is
installed. There is no retry and no wait, and the request that failed is sent again,
so no batch is lost. The switch and its cause appear on stderr, in the TUI just above
the prompt, and in the report. The next run tries the configured API first again.
proofpath never pulls the model;judge.fallback offturns this off. Without the
model, the run says how to add it (install Ollama,ollama pull qwen3.5:9b). /configrows for[search]andpermissions.web_search, and footer lines for what
was searched.scripts/eval_averitec.py --searchmeasures the product's own search path, leaving
out the claim's fact-checking site.
Changed
- The
ollamajudge's default model is nowqwen3.5:9b(wasllama3.1), always
asked with reasoning off. - The X hint says a pasted text with no link is searched when a provider is set.
- Pages proofpath found on its own are fetched without the contact address.
Fixed
- A bibliography entry that is only a DOI or arXiv URL is never reported as a
GHOST REFERENCE. It resolves, or it isAMBIGUOUS. A cache migration (v5) drops
ghost results cached under the old rule, so they are checked again.