Skip to content

Release v1.6.1

Latest

Choose a tag to compare

@marcomq marcomq released this 16 Nov 06:25
v1.6.1
7d12dc2

Fixes

  • Postgres cursor reads are fast again. Since 1.0.1 each page's query looked so expensive to the planner that Postgres JIT-compiled it every time, making a page several times slower than its rows. Which rows are read is unchanged. On older releases, ALTER ROLE <reader> SET jit = off avoids the cost.
  • An ordered sink gets nothing past a failed batch. With concurrency above 1, batches read behind a failed send to a file or object_store output were still written, so the retried batch landed after them. They are now handed back unsent.
  • Python and Node: a drain ends with a custom middleware on the input. A middleware registered with register_middleware / registerMiddleware did not pass exit_on_empty to the source, so the route never exited.
  • Python and Node: a custom middleware keeps the endpoint's ordering, flush and hooks. Behind a middleware on the output, a file sink with concurrency above 1 could write batches out of order, and commits could be released before a flush-durable sink flushed.

Performance

  • Python handlers: handler threads keep their Python thread state, and Caller.call() / JSON handlers encode faster. An HTTP route answering from a Python handler went from ~78k to ~87k req/s at 8 connections.
  • parallel and buffer no longer clone every message's outcome when settling a batch (about a third of the CPU on a batched lookup behind a Caller).
  • filter: number(field) compared with a number parses only that field instead of running the expression engine on a JSON value.

What's Changed

See CHANGELOG.md for details.

Full Changelog: v1.6.0...v1.6.1