Skip to content

v0.3.0

Choose a tag to compare

@github-actions github-actions released this 22 Oct 10:34

Each archive holds mbox2nntp, uatexport, ncexport and iafetch for one system, with README, CHANGELOG and LICENSE; unpack and run, nothing to install. Check downloads against the _checksums.txt file (sha256sum -c).

.gz, .zip, mbox and directory inputs, ncexport and iafetch need no other program. .7z inputs need 7-Zip, UAT archives (.usenet) need zstd, and .usenet.xz needs xz or 7-Zip: see the README.

Changes since v0.2.3

mbox2nntp

  • New counters dropped and binary in the summary and the per-file line:

    • dropped: messages read but never offered, for lacking a Message-ID or a body, or failing to parse;
    • binary: yEnc articles left out.

    Neither stops the input from being marked done, unless every message was dropped and none offered.

  • In directory mode, a file over 1 MiB counts as a 437, as in mbox mode.

  • The input file name in our Path element keeps only the characters RFC 5536 allows there. Every other character becomes _.

  • When unpacking fails to write, for example on a full disk, the error now says so, not "signal: killed".

ncexport

  • A .db is read one record at a time, never whole: memory no longer grows with its size.
  • -max-db SIZE (default 4G, 0 for no limit) replaces the fixed 256 MiB limit. A 64-bit NewsCache, as in the textusenet backup, can write bigger .db files. Skipped .db files are counted on their own, and the summary says their articles are missing.
  • -tmpdir DIR sets where a big .db from a tarball is copied while it is read. The default is the output's directory, not the system's temporary directory.
  • -missing FILE writes the articles a .db lists that are in neither the spool nor the export. One crossposted to another group is found there by Message-ID and is not written. The summary splits the count.
  • The dedup list kept every article's text in memory, not just its Message-ID. On rss.tar.gz peak memory went from 930 MB to 104 MB.
  • Ctrl-C and SIGTERM remove all temporary files.
  • A .db or a spool directory given as a symlink is read correctly.
  • A crafted .db can no longer turn a small file into gigabytes of articles.
  • An article over 1 MiB is skipped and counted, but no longer reported as missing.

newscache package: API changes, for anyone importing it.

  • Record has a new field Size. Unkeyed Record{...} literals no longer compile.
  • ParseDB leaves Data nil for a record over MaxArticleSize.
  • Stats.TooBig counts articles only. Skipped .db files are in the new Stats.BigDBs.
  • MaxDBSize is now 4 GiB, up from 256 MiB.
  • ReadTar copies a .db over 1 MiB to a temporary file in TempDir.
  • New: ReadDB, Listed, Missing, TempDir.

Full Changelog: v0.2.3...v0.3.0