Skip to content

Trellis 0.1.0-alpha

Pre-release
Pre-release

Choose a tag to compare

@github-actions github-actions released this 26 Oct 20:07
· 1118 commits to main since this release
31985aa

This is the first release of the trellis library and it's embedded clients (trellis-pg) as well as the CLI. In this initial version, we have are outlining the structure of the project, it's operating process and a small initial set of features.

What works today?

  • Building 1-to-1 transforms that compute values based on a single record
  • Building aggregated transforms (with a GROUP BY) so you can compute basic values from a group of records in the same table
    • including aggregates across large partitioned tables up to 1,000 leaf nodes
  • A small subset of SQL expression language like sum, count, avg, +, -
  • Strict correctness guarantees that once your transform shows a status of live, it will contain the same data as an equivalent query of its source data for anything other than staged data that is actively being processed
  • Prometheus metrics are available to track metrics on the number of source changes processed, a histogram of how long each individual transform takes and an end-to-end latency across all transforms in a given chain

** Validations **

Basic project metrics are published nightly.
This project has a rich set of test and validation harnesses that cover unit tests, integration tests, benchmarks and generative tests.
We capture notes on a subset of these kinds of activities and so far we've done 400+ validation runs, totaling 190+ hours of machine time and 13B+ database rows that have transited through Trellis and been verified correct against a live query.
We also have mechanisms built into the tool so you can run sampled self checks to detect any issues.
We keep detailed notes of all known correctness gaps which mostly come down to changes or actions we can't prevent the database owner from taking (like modifying our internal tables).