Skip to content

fix: bug for cli-pipelines template include path#3199

Merged
andrewnester merged 1 commit intomainfrom
pipelines-init-include-0
Jul 9, 2025
Merged

fix: bug for cli-pipelines template include path#3199
andrewnester merged 1 commit intomainfrom
pipelines-init-include-0

Conversation

@alyssa-db
Copy link
Copy Markdown
Contributor

@alyssa-db alyssa-db commented Jul 8, 2025

Changes

Changed include path in databricks.yml for cli-pipelines template to include project/*.yml files.

Why

Bug in include path has bundle deploy not recognize pipelines as resources.

Tests

Modified sample templates in tests to use new path.

@alyssa-db alyssa-db temporarily deployed to test-trigger-is July 8, 2025 19:48 — with GitHub Actions Inactive
@eng-dev-ecosystem-bot
Copy link
Copy Markdown
Collaborator

eng-dev-ecosystem-bot commented Jul 8, 2025 •
edited
Loading

Run: 16152955338

Env ✅‌pass ❌‌FAIL 🔄‌flaky 🙈‌skip
✅‌ aws linux 306 379
✅‌ aws windows 307 378
🔄‌ aws-ucws linux 404 8 279
🔄‌ aws-ucws windows 404 9 278
❌‌ azure linux 234 88 362
❌‌ azure windows 236 87 361
🔄‌ azure-ucws linux 406 8 276
🔄‌ azure-ucws windows 406 9 275
✅‌ gcp linux 305 380
✅‌ gcp windows 306 379
89 failing tests:
Test Name aws-ucws linux aws-ucws windows azure linux azure windows azure-ucws linux azure-ucws windows
TestAccept ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/deploy/dashboard/detect-change 🔄‌flaky 🔄‌flaky ❌‌FAIL ❌‌FAIL 🔄‌flaky 🔄‌flaky
TestAccept/bundle/deploy/dashboard/nested-folders 🔄‌flaky 🔄‌flaky ❌‌FAIL ❌‌FAIL 🔄‌flaky 🔄‌flaky
TestAccept/bundle/deploy/dashboard/simple 🔄‌flaky 🔄‌flaky ❌‌FAIL ❌‌FAIL 🔄‌flaky 🔄‌flaky
TestAccept/bundle/deploy/dashboard/simple_outside_bundle_root 🔄‌flaky 🔄‌flaky ❌‌FAIL ❌‌FAIL 🔄‌flaky 🔄‌flaky
TestAccept/bundle/deploy/dashboard/simple_syncroot 🔄‌flaky 🔄‌flaky ❌‌FAIL ❌‌FAIL 🔄‌flaky 🔄‌flaky
TestAccept/bundle/deploy/files/no-snapshot-sync ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/deploy/files/no-snapshot-sync/DATABRICKS_CLI_DEPLOYMENT=direct-exp ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/deploy/files/no-snapshot-sync/DATABRICKS_CLI_DEPLOYMENT=terraform ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/deploy/jobs/check-metadata ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/deploy/jobs/check-metadata/DATABRICKS_CLI_DEPLOYMENT=direct-exp ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/deploy/jobs/check-metadata/DATABRICKS_CLI_DEPLOYMENT=terraform ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/deploy/jobs/double-underscore-keys ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/deploy/jobs/fail-on-active-runs ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/deploy/jobs/fail-on-active-runs/DATABRICKS_CLI_DEPLOYMENT=direct-exp ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/deploy/jobs/fail-on-active-runs/DATABRICKS_CLI_DEPLOYMENT=terraform ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/deploy/mlops-stacks ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/deploy/pipeline/auto-approve ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/deploy/pipeline/auto-approve/DATABRICKS_CLI_DEPLOYMENT=direct-exp ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/deploy/pipeline/auto-approve/DATABRICKS_CLI_DEPLOYMENT=terraform ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/deploy/secret-scope ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/deployment/bind/cluster ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/deployment/bind/dashboard 🔄‌flaky 🔄‌flaky ❌‌FAIL ❌‌FAIL 🔄‌flaky 🔄‌flaky
TestAccept/bundle/deployment/bind/dashboard/recreation 🔄‌flaky 🔄‌flaky ❌‌FAIL ❌‌FAIL 🔄‌flaky 🔄‌flaky
TestAccept/bundle/deployment/bind/experiment ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/deployment/bind/job/generate-and-bind ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/deployment/bind/job/job-abort-bind ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/deployment/bind/job/job-spark-python-task ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/deployment/bind/model-serving-endpoint ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/destroy/jobs-and-pipeline ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/local_state_staleness ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/local_state_staleness/DATABRICKS_CLI_DEPLOYMENT=direct-exp ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/local_state_staleness/DATABRICKS_CLI_DEPLOYMENT=terraform ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/resources/clusters/deploy/simple ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/resources/pipelines ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/resources/pipelines/DATABRICKS_CLI_DEPLOYMENT=direct-exp ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/resources/pipelines/DATABRICKS_CLI_DEPLOYMENT=terraform ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=no/NBOOK=no/PY=no ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=no/NBOOK=no/PY=yes ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=no/NBOOK=yes/PY=no ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=no/NBOOK=yes/PY=yes ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=yes/NBOOK=no/PY=no ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=yes/NBOOK=no/PY=yes ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=yes/NBOOK=yes/PY=no ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=yes/NBOOK=yes/PY=yes ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=terraform/DLT=no/NBOOK=no/PY=no ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=terraform/DLT=no/NBOOK=no/PY=yes ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=terraform/DLT=no/NBOOK=yes/PY=no ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=terraform/DLT=no/NBOOK=yes/PY=yes ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=terraform/DLT=yes/NBOOK=no/PY=no ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=terraform/DLT=yes/NBOOK=no/PY=yes ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=terraform/DLT=yes/NBOOK=yes/PY=no ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=terraform/DLT=yes/NBOOK=yes/PY=yes ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/serverless ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=no/NBOOK=no/PY=no ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=no/NBOOK=no/PY=yes ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=no/NBOOK=yes/PY=no ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=no/NBOOK=yes/PY=yes ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=yes/NBOOK=no/PY=no ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=yes/NBOOK=no/PY=yes ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=yes/NBOOK=yes/PY=no ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=yes/NBOOK=yes/PY=yes ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_CLI_DEPLOYMENT=terraform/DLT=no/NBOOK=no/PY=no ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_CLI_DEPLOYMENT=terraform/DLT=no/NBOOK=no/PY=yes ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_CLI_DEPLOYMENT=terraform/DLT=no/NBOOK=yes/PY=no ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_CLI_DEPLOYMENT=terraform/DLT=no/NBOOK=yes/PY=yes ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_CLI_DEPLOYMENT=terraform/DLT=yes/NBOOK=no/PY=no ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_CLI_DEPLOYMENT=terraform/DLT=yes/NBOOK=no/PY=yes ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_CLI_DEPLOYMENT=terraform/DLT=yes/NBOOK=yes/PY=no ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_CLI_DEPLOYMENT=terraform/DLT=yes/NBOOK=yes/PY=yes ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/integration_classic ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/integration_classic/DATABRICKS_CLI_DEPLOYMENT=direct-exp/UV_PYTHON=3.10 ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/integration_classic/DATABRICKS_CLI_DEPLOYMENT=direct-exp/UV_PYTHON=3.11 ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/integration_classic/DATABRICKS_CLI_DEPLOYMENT=direct-exp/UV_PYTHON=3.12 ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/integration_classic/DATABRICKS_CLI_DEPLOYMENT=direct-exp/UV_PYTHON=3.13 ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/integration_classic/DATABRICKS_CLI_DEPLOYMENT=direct-exp/UV_PYTHON=3.9 ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/integration_classic/DATABRICKS_CLI_DEPLOYMENT=terraform/UV_PYTHON=3.10 ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/integration_classic/DATABRICKS_CLI_DEPLOYMENT=terraform/UV_PYTHON=3.11 ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/integration_classic/DATABRICKS_CLI_DEPLOYMENT=terraform/UV_PYTHON=3.12 ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/integration_classic/DATABRICKS_CLI_DEPLOYMENT=terraform/UV_PYTHON=3.13 ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestAccept/bundle/templates/default-python/integration_classic/DATABRICKS_CLI_DEPLOYMENT=terraform/UV_PYTHON=3.9 ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestDashboardAssumptions_WorkspaceImport 🔄‌flaky 🔄‌flaky ❌‌FAIL ✅‌pass 🔄‌flaky 🔄‌flaky
TestFetchRepositoryInfoAPI_FromRepo ✅‌pass 🔄‌flaky ✅‌pass ✅‌pass ✅‌pass 🔄‌flaky
TestGenerateFromExistingJobAndDeploy ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestGenerateFromExistingPipelineAndDeploy ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestSparkJarTaskDeployAndRunOnWorkspace ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestSparkJarTaskDeployAndRunOnWorkspace/Databricks_Runtime_14.3_LTS ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass
TestSparkJarTaskDeployAndRunOnWorkspace/Databricks_Runtime_15.4_LTS ✅‌pass ✅‌pass ❌‌FAIL ❌‌FAIL ✅‌pass ✅‌pass

jefferycheng1
jefferycheng1 reviewed Jul 9, 2025
View reviewed changes
Comment thread acceptance/pipelines/init/error-cases/output/my_project/databricks.yml
kanterov
kanterov reviewed Jul 9, 2025
View reviewed changes
Comment thread acceptance/pipelines/init/sql/output/my_sql_project/databricks.yml
@andrewnester andrewnester merged commit 4609db6 into main Jul 9, 2025
12 of 13 checks passed
@andrewnester andrewnester deleted the pipelines-init-include-0 branch July 9, 2025 08:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@kanterov kanterov kanterov left review comments

@jefferycheng1 jefferycheng1 jefferycheng1 left review comments

@andrewnester andrewnester andrewnester approved these changes

@lennartkats-db lennartkats-db Awaiting requested review from lennartkats-db

@pietern pietern Awaiting requested review from pietern

@shreyas-goenka shreyas-goenka Awaiting requested review from shreyas-goenka

@denik denik Awaiting requested review from denik

@anton-107 anton-107 Awaiting requested review from anton-107

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@alyssa-db @eng-dev-ecosystem-bot @kanterov @andrewnester @jefferycheng1