Repository navigation
v0.1.3
Capturing one person's share of a community
Asked for "only me", a community capture used to read all of it anyway — every
forum topic and every reply — because whether a thread is yours is only
knowable once its replies have been read. In a busy community that is tens of
thousands of entries fetched to keep a few hundred threads.
- The capture now asks the deployment's own Search which threads in that
community the person is in, and reads those. Each selected thread is still
read in full — topic, every reply, attachments and images — and the author
filter still decides what is kept. Search chooses what to read; it never
stands in for the content and never decides what is yours. - The Ingest view says what happened: how many threads were chosen out of how
many hits, whether the answer was complete, and — the case that matters —
whether it fell back to reading the forums in full. Falling back is always
available and always correct; it is never silent. - Only a user id the deployment itself returned is used, which the console gets
from Only me or from resolving a person by email. A name typed by hand
reads the forums in full instead.connections-export crawltakes
--search-useridfor the same thing, explicitly, because a command line
cannot tell a resolved id from a typed one. - Fixed: a capture seeded this way ignored the Preview limit, and did not apply
the author filter to the threads it fetched. - Fixed: a community captured from the command line produced wikis that did not
record which community they belonged to. - Fixed: the recovery of forum attachment filenames ran even on a capture that
was not collecting assets.
The live Ingest view
- A console that reconnects or is reloaded during a capture no longer loses the
part of the run it missed, and no longer counts it twice. The stream is
replayable, and a connection the browser silently re-establishes resumes
where it left off rather than starting over. - A stream opened after a capture has finished now ends, instead of replaying
the run and then staying open forever. - An author-filtered run shows a live count of what it has read but not kept.
Such a run must read every thread before it can know whether you are in it,
so it fetches steadily while the kept tree stands still — which used to read
as stalled at the moment it was working hardest. - A pruned item is now labelled by its id. It used to be formatted as a URL,
which made every pruned line claim to have been fetched from the console
itself.
Archives
- The archive list has a stable order. Archives written in the same second
share a modification time, and the list then fell back to whatever order the
filesystem returned — so two listings of a directory nobody had touched
could disagree, differently on Linux, macOS and Windows.
Diagnostics
- New
connections-export probe search-reach: asks how far a person's Search
query reaches — how many pages came back and whether the last was full —
without crawling anything. It exits non-zero when the answer was cut short at
the page limit, so a comparison run under the same limit is not read as
complete. compare-authorreports progress while it works. It crawls a whole container
before it can compare anything, and used to print nothing at all until the
table at the end, where an hour of silence is indistinguishable from a hang.compare-authornow distinguishes an answer that ended because there was no
more from one cut short at the page limit. They produced identical output, so
a truncated answer read exactly like a complete one.- Probes check their arguments before opening a connection, and report an
authentication failure as something to act on rather than as a stack trace.
Development
just sync-sspi, andjust console, install the Windows integrated-auth
extra — so a development console authenticates the way the released one does.