Skip to content

v0.1.3

Choose a tag to compare

@github-actions github-actions released this 06 Sep 21:10
· 23 commits to main since this release

Capturing one person's share of a community

Asked for "only me", a community capture used to read all of it anyway — every
forum topic and every reply — because whether a thread is yours is only
knowable once its replies have been read. In a busy community that is tens of
thousands of entries fetched to keep a few hundred threads.

  • The capture now asks the deployment's own Search which threads in that
    community the person is in, and reads those. Each selected thread is still
    read in full — topic, every reply, attachments and images — and the author
    filter still decides what is kept. Search chooses what to read; it never
    stands in for the content and never decides what is yours.
  • The Ingest view says what happened: how many threads were chosen out of how
    many hits, whether the answer was complete, and — the case that matters —
    whether it fell back to reading the forums in full. Falling back is always
    available and always correct; it is never silent.
  • Only a user id the deployment itself returned is used, which the console gets
    from Only me or from resolving a person by email. A name typed by hand
    reads the forums in full instead. connections-export crawl takes
    --search-userid for the same thing, explicitly, because a command line
    cannot tell a resolved id from a typed one.
  • Fixed: a capture seeded this way ignored the Preview limit, and did not apply
    the author filter to the threads it fetched.
  • Fixed: a community captured from the command line produced wikis that did not
    record which community they belonged to.
  • Fixed: the recovery of forum attachment filenames ran even on a capture that
    was not collecting assets.

The live Ingest view

  • A console that reconnects or is reloaded during a capture no longer loses the
    part of the run it missed, and no longer counts it twice. The stream is
    replayable, and a connection the browser silently re-establishes resumes
    where it left off rather than starting over.
  • A stream opened after a capture has finished now ends, instead of replaying
    the run and then staying open forever.
  • An author-filtered run shows a live count of what it has read but not kept.
    Such a run must read every thread before it can know whether you are in it,
    so it fetches steadily while the kept tree stands still — which used to read
    as stalled at the moment it was working hardest.
  • A pruned item is now labelled by its id. It used to be formatted as a URL,
    which made every pruned line claim to have been fetched from the console
    itself.

Archives

  • The archive list has a stable order. Archives written in the same second
    share a modification time, and the list then fell back to whatever order the
    filesystem returned — so two listings of a directory nobody had touched
    could disagree, differently on Linux, macOS and Windows.

Diagnostics

  • New connections-export probe search-reach: asks how far a person's Search
    query reaches — how many pages came back and whether the last was full —
    without crawling anything. It exits non-zero when the answer was cut short at
    the page limit, so a comparison run under the same limit is not read as
    complete.
  • compare-author reports progress while it works. It crawls a whole container
    before it can compare anything, and used to print nothing at all until the
    table at the end, where an hour of silence is indistinguishable from a hang.
  • compare-author now distinguishes an answer that ended because there was no
    more from one cut short at the page limit. They produced identical output, so
    a truncated answer read exactly like a complete one.
  • Probes check their arguments before opening a connection, and report an
    authentication failure as something to act on rather than as a stack trace.

Development

  • just sync-sspi, and just console, install the Windows integrated-auth
    extra — so a development console authenticates the way the released one does.