You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
insert load_id into the _dlt_versions, see SqlJobClientBase
you need to change the _dlt_versions schema definition (schema/utils.py) - make sure it is NULLABLE so old dlt installations can migrate
we need to increase schema engine version and write migration that will add the column to existing schema (schema/utils.py)
Tests
Extend existing tests for updating schema and make sure the load_id is stored (test_job_client.py)
Test the schema migration: mock the schema to not have this column, load data, then load the schema again and load the data again to make sure the schema was added
The text was updated successfully, but these errors were encountered:
Background
We want the users to be able to link the loads in
_dlt_loads
to_dlt_versions
to identify which load updated the schema without enabling the trace (https://dlthub.com/docs/running-in-production/running#inspect-and-save-the-load-info-and-trace).Tasks
load_id
into the_dlt_versions
, seeSqlJobClientBase
_dlt_versions
schema definition (schema/utils.py
) - make sure it is NULLABLE so old dlt installations can migrateschema/utils.py
)Tests
load_id
is stored (test_job_client.py
)The text was updated successfully, but these errors were encountered: