Metaxy is a metadata layer for multi-modal Data and ML pipelines that tracks feature versions, dependencies, and data lineage across complex computation graphs.
Metaxy supports incremental computations, sample-level versioning, field-level versioning, and more.
Warning
This project is as raw as a steak still saying ‘moo.’
Read the few docs we have to learn more.
Setting up the environment:
uv sync --all-extras
uv run prek installYou are also expected to install system dependencies such as clickhouse and others. These can be found in flake.nix.
Nix and direnv users can flex with direnv allow - this will automatically setup the environment for you, including all system dependencies and Python packages. We also have Nix dev shells for all supported Python versions:
nix develop # enters a shell with the lowest supported Python version
nix develop '.#"python3.11"' # enters a shell with Python 3.11See examples.