Repository navigation
v0.1.0 the first real release
This is the first release of the trellis library and it's embedded clients (trellis-pg) as well as the CLI. In this initial version, we are outlining the structure of the project, it's operating process and a small initial set of features.
What works today?
- Building 1-to-1 transforms that compute values based on a single record
- Building aggregated transforms (with a GROUP BY) so you can compute basic values from a group of records in the same table
- including aggregates across large partitioned tables up to 1,000 leaf nodes
- A small subset of SQL expression language like
sum,count,avg,+,- - Strict correctness guarantees that once your transform shows a status of
live, it will contain the same data as an equivalent query of its source data for anything other than staged data that is actively being processed - Prometheus metrics are available to track the number of source changes processed, a histogram of how long each individual transform takes and an end-to-end latency across all transforms in a given chain
** Validations **
Basic project metrics are published nightly.
This project has a rich set of test and validation harnesses that cover unit tests, integration tests, benchmarks and generative tests.
We capture notes on a subset of these kinds of activities and so far we've done 450+ validation runs, totaling 210+ hours of machine time and 13.6B+ database rows that have transited through Trellis and been verified correct against a live query.
We also have mechanisms built into the tool so you can run sampled self checks to detect any issues.
We keep detailed notes of all known correctness gaps which mostly come down to changes or actions we can't prevent the database owner from taking (like modifying our internal tables).
Full Changelog: The entire git history of up v0.1.0, too much to summarize here