Repository navigation
Before you upgrade
-
generate airflow-dagsnow requires the Airflow version (#682). DAGs generated for Airflow 2 don't load on Airflow 3 and the other way around, so the command stops without generating anything unless you pass--airflow-version 2|3or set it in.dbt_coves/config.yml:generate: airflow_dags: airflow_version: 3 # or 2, matching your Airflow
Datacoves users: the VS Code task that generates a DAG from the open YML file runs in your dbt project folder. Set
airflow_versionin that folder's.dbt_coves/config.yml(the one under$DATACOVES__DBT_HOME, not the repository root), or the task fails after the upgrade. If one repository serves both Airflow 2 and Airflow 3 environments, read the value from an environment variable you set per environment:airflow_version: "{{ env_var('MY_AIRFLOW_VERSION') }}". -
blue-greenstops before deploying if production has grants it can't carry across the swap (#677). If the production database or one of its schemas is granted to a database role, share, user or application, the deploy now stops beforedbt buildwith a list of those grants, where it used to swap and silently drop them. Production isn't touched. -
Copied
generate sourcestemplates need updating (#681, and themodel_namefix below). If you copied the templates withdbt-coves generate templates, use the newsourceandmodel_namevariables, or copy the templates again. See Source names in templates.
blue-green
- Database parameters (e.g.
DATA_RETENTION_TIME_IN_DAYS), the database comment,MANAGED ACCESSon schemas, and future and inherited grants on the database and its schemas now survive the swap. Before, a deploy silently reset them, so objects built during the deploy could end up without their reader grants (#677). - The Snowflake connection is closed when the run ends (#683).
- New docs section on views: a view that names its database breaks after the swap, and how to avoid it with a
ref()override.
generate sources
- The staging model's
source()call now matchessources.yml. With the default templates, generated Snowflake staging models used to faildbt parse(#681). - Snowflake tables and schemas created with quoted names (lowercase, mixed case, spaces, reserved words) work: they keep their exact case and get a
quoting:block insources.yml. JSON flattening quotes the names too (#681). --flatten-json-fields yesno longer skips tables without JSON columns (#685).- Flattened JSON keys no longer produce duplicate column names. A key whose name is already taken, e.g. a
typekey in two JSON columns plus aTYPEcolumn, is prefixed with its JSON column's name (properties_type). Other keys keep their names. - The staging model's properties file names the model after its
.sqlfile, so amodels_destinationlikestg_{{relation}}.sqlno longer produces properties dbt can't match ("Did not find matching node for patch").
generate properties
--profiles-dir,--profile,--target,--varsand--target-pathare passed to thedbt lsrun that lists your models. Properties used to be generated from the default target's tables (#680).
generate airflow-dags
- Generated DAGs are adapted to the Airflow version: decorator imports, renamed arguments (e.g.
schedule_interval→schedulefor Airflow 3) and warnings for behaviour changes (#682). --validate-operatorsno longer crashes on valid operators (#682).- The dbt generators read
manifest.jsonfrom the project's target path instead of alwaystarget/(#685). - A
--yml-paththat doesn't exist is a clear error. A single YML file outside the Datacoves DAGs YML folder no longer fails withValueError: ... is not in the subpath of ....
generate metadata
- JSON columns are sampled with quoted names on Snowflake, so quoted tables and columns work (#685).
All commands
--varsworks again with dbt 1.8 and later. Any value crashed withTypeError: 'str' object is not a mapping.- Errors are reported as a message, without a Python traceback, unless they're unexpected; add
-vvor--log-level debugto see it. Errors are no longer printed twice (#685). - Properties files dbt-coves rewrites no longer re-wrap long descriptions or leave trailing spaces.