Skip to content

Beta 7

Latest

Choose a tag to compare

@Mevrael Mevrael released this 05 Jun 15:24
  • NEW: Migrations for database and a data warehouse. New CLI commands to create and run migrations. Check uv run arkalos for details.
  • NEW: Powerful and low-level DDL (CREATE and ALTER TABLE) and DML query builders powered by sqlglot and ibis.
  • Revamped data warehouse. DWH now has 3 layers built-in: raw (bronze), clean (silver) and BI (gold).
  • Partial support for DuckDB data warehouse. Just change DWH_ENGINE to duckdb in the .env and try out.
  • Updated Workflow class. Use execute() method now to execute workflows. Uses new logging system and tracks the execution time.
  • Updated ETLWorkflow to import data from the TabularDataExtractor-based class into the raw layer of the data warehouse.