Skip to content

Zettelkasten 0.1.1

Latest

Choose a tag to compare

@arkane-dev arkane-dev released this 24 Oct 14:24

Bug fixes for summaries and community reports.

Summaries are checked against the source. Each claim in a summary is tested against the passages of the source that match it best. A claim the source contradicts is corrected, and one it doesn't support is dropped. Papers lose their reference lists and appendices first. The prompts no longer let the model guess what an abbreviation means or flip a comparison. That's how a summary of the ReAct paper turned "ReAct-IM" into "intermediate memory".

On 18 test documents, judged claim by claim by a second model, problem claims fell from 5 to 7 per run to 2. On review, those 2 were the judge's mistakes. A summary now takes about 25% longer.

Community reports start with their topic. They no longer open with "These excerpts discuss…" or "This report examines…". In 20 reports, that went from 12 to 0.

Smaller fixes

  • Lead-ins like "Here are the key points:" are stripped from summaries.
  • Sentences no longer split after "Mrs.", "e.g." or "et al.", so the check never drops half a sentence.

Upgrading: git pull, then make setup and make plugin, and copy the plugin files into your vault, or run scripts/new-vault.sh for a new one. Existing summaries and reports keep their old text. "Summarise this source again" and "Rebuild communities and rewrite every report" refresh them.

The theme is unchanged, still NEONDECK 0.1.0, and included here for convenience.

eval/summary_eval.py reruns the measurement.