[Bug] Missing Arg active_integrations

[amw349]

Describe the bug
I'm trying to run dbt test operator on Airflow, but I keep getting error: TypeError: parse_manifest() missing 1 required positional argument: 'active_integrations'. I have my manifest.json file in my dbt/target directory. I'm using AWS Secrets Manager as my secrets backend to store my profile details.

test_source_data = DbtTestOperator(
        task_id="test_source_data",
        dbt_conn_id=Config.REDSHIFT_RW_CONN_ID,
        project_dir=Config.DBT_BACKOFFICE_DIR,
        target=Config.REDSHIFT_RW_CONN_ID,
        threads=2,
        debug=True,
        select=["tag:src_communications"],
    )

requirements.txt

airflow-dbt-python==3.0.3
airflow-dbt-python[redshift]
apache-airflow-providers-slack==8.9.1
apache-airflow-providers-sftp==4.11.1

Airflow

• Version: 2.10.3
• Provider: MWAA

Dbt

• Version: Which version of dbt are you using?

[tomasfarias]

Hi!

Which version of dbt are you using?

It would appear the active_integrations argument to parse_manifest was added about two weeks ago: dbt-labs/dbt-core@3e31117, and released as part of dbt 1.10.7.

I'd imagine all newer versions of dbt are affected. We can probably fix the bug by adding the missing parameter, but in the meantime you could try downgrading to 1.10.6 or earlier. If this works, it would confirm the source of the bug, so any update is appreciated!

[amw349]

Yup. It's installing dbt-core 1.10.9 which is the latest version. Should I just express the explicit version of dbt-core as part of the requirements.txt?

[amw349]

Error is gone now that I downgraded to dbt-core 1.10.6.

[tomasfarias]

Thanks for confirming that. Seems like the bug is correctly identified. I've opened up a PR to test a fix for the bug and add support for dbt>=1.10.7: #161.

For now, I am not focusing on what active_integrations is actually meant for, just ensuring we don't crash.

[tomasfarias]

Looks like the PR addresses the issue, I'll deploy version 3.0.4 with the fix to support for dbt 1.10.7 and later. The actual feature change supported with active_integrations can be developed later.

[amw349]

Thank you Tomas!