Skip to content

0.2.0a16

Pre-release
Pre-release
Compare
Choose a tag to compare
@rudolfix rudolfix released this 31 Jan 16:39
· 2398 commits to devel since this release
0.2.0a16
791d7dc
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

What's Changed

  • uses structured data types to store json by @rudolfix in #121
  • brings back the functionality to run dbt packages by @rudolfix in #122

This update changes how the complex data type is being stored. Most often complex data type is generated to hold json data when nesting_level is limited in the source. The complex types are stored as JSONB (postgres), SUPER (redshift), JSON (BigQuery)

This update also allows to easily run dbt packages together with dlt pipelines. Most of the work went into making it user friendly and avoiding any dependency conflicts. This feature is also quite well tested. Take a look at those two examples:
https://github.com/dlt-hub/dlt/blob/devel/docs/examples/dbt_run_jaffle.py
https://github.com/dlt-hub/dlt/blob/devel/docs/examples/chess/chess_dbt.py
https://github.com/dlt-hub/dlt/tree/devel/docs/examples/chess/dbt_transform

Runing the dbt package is just two lines and you have more control over it that with the CLI

Contributors

rudolfix
Assets 2
Loading