Convert TestGenerateAndBind to an acceptance test by anton-107 · Pull Request #3160 · databricks/cli

anton-107 · 2025-07-01T15:41:05Z

Why

One change in the series of changes for converting integration tests into acceptance tests.
This will allow for easier testing of various backing solutions for bundle deployment

eng-dev-ecosystem-bot · 2025-07-01T15:59:12Z

Run: 16022149789

	Env	✅‌pass	❌‌FAIL	💥‌PANIC	🔄‌flaky	🙈‌skip	🤯‌MISS
❌‌	aws linux	238	31	2		371	25
❌‌	aws windows	233	38	2		370	24
🔄‌	aws-ucws linux	397			2	272
🔄‌	aws-ucws windows	399			1	271
✅‌	azure linux	297				371
✅‌	azure windows	298				370
💥‌	azure-ucws linux	391		1		269	9
❌‌	azure-ucws windows	389	2	1		268	10
❌‌	gcp linux	275	21			373
✅‌	gcp windows	297				372

76 failing tests:

Test Name	aws linux	aws windows	aws-ucws linux	aws-ucws windows	azure-ucws linux	azure-ucws windows	gcp linux
TestAccept	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL	❌‌FAIL
TestAccept/bundle/deploy/dashboard/nested-folders	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/deploy/files/no-snapshot-sync	❌‌FAIL	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/deploy/files/no-snapshot-sync/DATABRICKS_CLI_DEPLOYMENT=direct-exp	❌‌FAIL	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/deploy/jobs/fail-on-active-runs	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/deploy/jobs/fail-on-active-runs/DATABRICKS_CLI_DEPLOYMENT=terraform	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/deploy/mlops-stacks	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/deploy/secret-scope	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/deployment/bind/dashboard	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/deployment/bind/dashboard/recreation	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL	✅‌pass
TestAccept/bundle/deployment/bind/experiment	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/deployment/bind/job/job-spark-python-task	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/local_state_staleness	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/local_state_staleness/DATABRICKS_CLI_DEPLOYMENT=direct-exp	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/local_state_staleness/DATABRICKS_CLI_DEPLOYMENT=terraform	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/resources/pipelines	🤯‌MISS	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL
TestAccept/bundle/resources/pipelines/DATABRICKS_CLI_DEPLOYMENT=direct-exp	🤯‌MISS	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/resources/pipelines/DATABRICKS_CLI_DEPLOYMENT=terraform	❌‌FAIL	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL
TestAccept/bundle/templates/default-python/combinations/classic	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=no/NBOOK=no/PY=no	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=no/NBOOK=no/PY=yes	🤯‌MISS	💥‌PANIC	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=no/NBOOK=yes/PY=no	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=no/NBOOK=yes/PY=yes	💥‌PANIC	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=yes/NBOOK=no/PY=no	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=yes/NBOOK=no/PY=yes	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=yes/NBOOK=yes/PY=no	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=direct-exp/DLT=yes/NBOOK=yes/PY=yes	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=terraform/DLT=no/NBOOK=no/PY=no	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=terraform/DLT=no/NBOOK=no/PY=yes	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=terraform/DLT=no/NBOOK=yes/PY=no	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=terraform/DLT=no/NBOOK=yes/PY=yes	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=terraform/DLT=yes/NBOOK=no/PY=no	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=terraform/DLT=yes/NBOOK=no/PY=yes	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=terraform/DLT=yes/NBOOK=yes/PY=no	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_CLI_DEPLOYMENT=terraform/DLT=yes/NBOOK=yes/PY=yes	❌‌FAIL	🤯‌MISS	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/templates/default-python/integration_classic	❌‌FAIL	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL
TestAccept/bundle/templates/default-python/integration_classic/DATABRICKS_CLI_DEPLOYMENT=terraform/UV_PYTHON=3.10	❌‌FAIL	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL
TestAccept/bundle/templates/default-python/integration_classic/DATABRICKS_CLI_DEPLOYMENT=terraform/UV_PYTHON=3.11	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL
TestAccept/bundle/templates/default-python/integration_classic/DATABRICKS_CLI_DEPLOYMENT=terraform/UV_PYTHON=3.12	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/templates/default-python/integration_classic/DATABRICKS_CLI_DEPLOYMENT=terraform/UV_PYTHON=3.13	❌‌FAIL	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/bundle/templates/default-python/integration_classic/DATABRICKS_CLI_DEPLOYMENT=terraform/UV_PYTHON=3.9	❌‌FAIL	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/selftest/record_cloud/workspace-file-io	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/selftest/record_cloud/workspace-file-io/DATABRICKS_CLI_DEPLOYMENT=direct-exp	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestAccept/selftest/record_cloud/workspace-file-io/DATABRICKS_CLI_DEPLOYMENT=terraform	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestFetchRepositoryInfoAPI_FromRepo	❌‌FAIL	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestFilerReadDir	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL
TestFilerReadDir/workspace_files	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL
TestFilerReadDir/workspace_files_extensions	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL
TestFilerReadWrite	❌‌FAIL	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL
TestFilerReadWrite/workspace_files_extensions	❌‌FAIL	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL
TestFilerRecursiveDelete	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL
TestFilerRecursiveDelete/workspace_files	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL
TestFilerWorkspaceFilesExtensionsDelete	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL
TestFilerWorkspaceFilesExtensionsRead	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL
TestFilerWorkspaceFilesExtensionsReadDir	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL
TestFilerWorkspaceFilesExtensionsStat	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL
TestInprocessMode	🤯‌MISS	🤯‌MISS	🙈‌skip	🙈‌skip	🙈‌skip	🙈‌skip	🙈‌skip
TestLock	❌‌FAIL	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestReposCreateWithProvider	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestReposCreateWithoutProvider	❌‌FAIL	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestReposDeleteByID	❌‌FAIL	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestReposDeleteByPath	❌‌FAIL	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestReposGet	✅‌pass	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestReposUpdate	❌‌FAIL	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	✅‌pass
TestSyncEnsureRemotePathIsUsableIfRepoDoesntExist	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	🤯‌MISS	🤯‌MISS	✅‌pass
TestSyncEnsureRemotePathIsUsableIfRepoExists	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	🤯‌MISS	🤯‌MISS	✅‌pass
TestSyncEnsureRemotePathIsUsableInWorkspace	🤯‌MISS	🤯‌MISS	✅‌pass	✅‌pass	🤯‌MISS	🤯‌MISS	✅‌pass
TestSyncFullFileSync	❌‌FAIL	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	✅‌pass	❌‌FAIL
TestSyncIncrementalFileOverwritesFolder	❌‌FAIL	❌‌FAIL	🔄‌flaky	✅‌pass	🤯‌MISS	🤯‌MISS	✅‌pass
TestSyncIncrementalFileSync	❌‌FAIL	❌‌FAIL	✅‌pass	✅‌pass	✅‌pass	💥‌PANIC	✅‌pass
TestSyncIncrementalSyncFileToPythonNotebook	✅‌pass	✅‌pass	✅‌pass	✅‌pass	🤯‌MISS	🤯‌MISS	✅‌pass
TestSyncIncrementalSyncPythonNotebookDelete	💥‌PANIC	💥‌PANIC	✅‌pass	✅‌pass	🤯‌MISS	🤯‌MISS	✅‌pass
TestSyncIncrementalSyncPythonNotebookToFile	✅‌pass	❌‌FAIL	🔄‌flaky	🔄‌flaky	🤯‌MISS	🤯‌MISS	✅‌pass
TestSyncNestedFolderDoesntFailOnNonEmptyDirectory	❌‌FAIL	❌‌FAIL	✅‌pass	✅‌pass	🤯‌MISS	🤯‌MISS	✅‌pass
TestSyncNestedFolderSync	❌‌FAIL	❌‌FAIL	✅‌pass	✅‌pass	💥‌PANIC	🤯‌MISS	✅‌pass
TestSyncNestedSpacePlusAndHashAreEscapedSync	❌‌FAIL	❌‌FAIL	✅‌pass	✅‌pass	🤯‌MISS	🤯‌MISS	✅‌pass

shreyas-goenka

looks good to me, but seems like the test is failing.

…erated yaml

anton-107 · 2025-07-02T11:36:50Z

Test failures are not relevant to the change

anton-107 temporarily deployed to test-trigger-is July 1, 2025 15:41 — with GitHub Actions Inactive

anton-107 temporarily deployed to test-trigger-is July 1, 2025 15:44 — with GitHub Actions Inactive

anton-107 marked this pull request as ready for review July 1, 2025 15:45

anton-107 requested review from andrewnester, denik, pietern and shreyas-goenka as code owners July 1, 2025 15:45

shreyas-goenka reviewed Jul 1, 2025

View reviewed changes

Comment thread acceptance/bundle/deployment/bind/job/generate-and-bind/script Outdated

Comment thread acceptance/bundle/deployment/bind/job/generate-and-bind/script Outdated

anton-107 temporarily deployed to test-trigger-is July 2, 2025 08:34 — with GitHub Actions Inactive

anton-107 added 5 commits July 2, 2025 10:35

Convert TestGenerateAndBind to an acceptance test

9cc74ed

remove the original test

6761184

make fmtfull

d106d0f

make the test work cross-cloud: only grep the name field from the gen…

787014d

…erated yaml

rename script variables

5f01e85

anton-107 force-pushed the anton-107/acc-generate-bind branch from ff67bff to 5f01e85 Compare July 2, 2025 08:35

anton-107 temporarily deployed to test-trigger-is July 2, 2025 08:35 — with GitHub Actions Inactive

denik reviewed Jul 2, 2025

View reviewed changes

Comment thread acceptance/bundle/deployment/bind/job/generate-and-bind/script

denik reviewed Jul 2, 2025

View reviewed changes

Comment thread acceptance/bundle/deployment/bind/job/generate-and-bind/test.toml

set MSYS_NO_PATHCONV = "1"

529e7f8

anton-107 temporarily deployed to test-trigger-is July 2, 2025 09:05 — with GitHub Actions Inactive

add a replacement for dir separators (fix test on windows)

b55a1b5

anton-107 temporarily deployed to test-trigger-is July 2, 2025 09:29 — with GitHub Actions Inactive

add a comment on the reason why local test is disabled

7cc93a7

anton-107 temporarily deployed to test-trigger-is July 2, 2025 10:02 — with GitHub Actions Inactive

anton-107 requested review from denik and shreyas-goenka July 2, 2025 11:36

denik approved these changes Jul 2, 2025

View reviewed changes

anton-107 merged commit 9138476 into main Jul 2, 2025
12 of 13 checks passed

anton-107 deleted the anton-107/acc-generate-bind branch July 2, 2025 11:54

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Convert TestGenerateAndBind to an acceptance test #3160

Convert TestGenerateAndBind to an acceptance test #3160
anton-107 merged 8 commits intomainfrom
anton-107/acc-generate-bind

anton-107 commented Jul 1, 2025

Uh oh!

eng-dev-ecosystem-bot commented Jul 1, 2025 •

edited

Loading

Uh oh!

shreyas-goenka left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

anton-107 commented Jul 2, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Conversation

anton-107 commented Jul 1, 2025

Why

Uh oh!

eng-dev-ecosystem-bot commented Jul 1, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

shreyas-goenka left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

anton-107 commented Jul 2, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

eng-dev-ecosystem-bot commented Jul 1, 2025 •

edited

Loading