Add runner to run tests on DBR by shreyas-goenka · Pull Request #4416 · databricks/cli

shreyas-goenka · 2026-02-02T04:28:33Z

Changes

Other than the above change, this PR also:

Adds a runner to run tests on DBR.
Sets the RunOnDbr option for all currrent eligible tests. Note: This option cannot be used with RecordRequest = true because serverless does not allow localhost connections.
Adds new tests (in the acceptance/dbr directory) that ensure that the FUSE changes are not a regression.

Tests

Manually verified that both bundle deploy / bundle generate continue to work correctly on DBR. Also verified that bundle generate --bind works on DBR.

New acceptance tests for DBR.

eng-dev-ecosystem-bot · 2026-02-04T16:17:37Z

Commit: a272cba

Run: 21710260602

	Env	❌FAIL	🟨KNOWN	🔄flaky	💚RECOVERED	🙈SKIP	✅pass	🙈skip	Time
🟨	aws linux		7		1	7	448	734	26:25
🟨	aws windows		7		1	7	414	744	22:43
❌	aws-ucws linux	2	3		9	5	701	585	71:56
❌	aws-ucws windows	2	3		9	5	664	596	65:10
🔄	azure linux			4	2	9	444	733	31:22
🔄	azure windows			3	1	9	412	743	26:15
❌	azure-ucws linux	2	1		5	7	663	596	64:28
❌	azure-ucws windows	2	1		5	7	626	607	53:49
🔄	gcp linux			3	1	9	435	739	26:22
💚	gcp windows				2	9	403	749	23:00

27 interesting tests: 8 flaky, 7 KNOWN, 5 SKIP, 5 RECOVERED, 2 FAIL

	Test Name	aws linux	aws windows	aws-ucws linux	aws-ucws windows	azure linux	azure windows	azure-ucws linux	azure-ucws windows	gcp linux	gcp windows
🟨	TestAccept	🟨K	🟨K	🟨K	🟨K	💚R	🔄f	🟨K	🟨K	🔄f	💚R
🔄	TestAccept/bundle/config-remote-sync/job_pipeline_task	✅p	🙈s	✅p	🙈s	🔄f	🙈s	✅p	🙈s	✅p	🙈s
🔄	TestAccept/bundle/config-remote-sync/job_pipeline_task/DATABRICKS_BUNDLE_ENGINE=direct	✅p		✅p		🔄f		✅p		✅p
❌	TestAccept/bundle/dbr/deploy-notebooks	🙈s	🙈s	❌F	❌F	🙈s	🙈s	❌F	❌F	🙈s	🙈s
❌	TestAccept/bundle/dbr/generate-bind	🙈s	🙈s	❌F	❌F	🙈s	🙈s	❌F	❌F	🙈s	🙈s
🙈	TestAccept/bundle/deployment/bind/alert	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/generate/alert	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
💚	TestAccept/bundle/invariant/no_drift	🙈S	🙈S	💚R	💚R	🙈S	🙈S	💚R	💚R	🙈S	🙈S
🙈	TestAccept/bundle/resources/alerts/basic	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/alerts/with_file	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🔄	TestAccept/bundle/resources/dashboards/delete-trashed-out-of-band	✅p	✅p	✅p	✅p	✅p	🔄f	✅p	✅p	✅p	✅p
🔄	TestAccept/bundle/resources/dashboards/delete-trashed-out-of-band/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	🔄f	✅p	✅p	✅p	✅p
🙈	TestAccept/bundle/resources/permissions	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions	🟨K	🟨K	🟨K	🟨K	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=direct	🟨K	🟨K	🟨K	🟨K
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=terraform	🟨K	🟨K	💚R	💚R
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions	🟨K	🟨K	💚R	💚R	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=direct	🟨K	🟨K	💚R	💚R
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=terraform	🟨K	🟨K	💚R	💚R
🔄	TestAccept/bundle/resources/pipelines/allow-duplicate-names	✅p	✅p	✅p	✅p	🔄f	✅p	✅p	✅p	✅p	✅p
🔄	TestAccept/bundle/resources/pipelines/allow-duplicate-names/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	🔄f	✅p	✅p	✅p	✅p	✅p
💚	TestAccept/bundle/resources/synced_database_tables/basic	🙈S	🙈S	💚R	💚R	🙈S	🙈S	💚R	💚R	🙈S	🙈S
💚	TestAccept/bundle/resources/synced_database_tables/basic/DATABRICKS_BUNDLE_ENGINE=direct			💚R	💚R			💚R	💚R
💚	TestAccept/bundle/resources/synced_database_tables/basic/DATABRICKS_BUNDLE_ENGINE=terraform			💚R	💚R			💚R	💚R
🔄	TestAccept/bundle/templates/default-python/combinations/classic	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	🔄f	✅p
🔄	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=yes/NBOOK=yes/PY=yes/READPLAN=1	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	🔄f	✅p
💚	TestAccept/ssh/connection	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R

Top 50 slowest tests (at least 2 minutes):

duration	env	testname
11:09	aws-ucws windows	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=synced_database_table.yml.tmpl
9:35	aws-ucws linux	TestAccept/bundle/invariant/migrate/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=database_instance.yml.tmpl
8:32	azure windows	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
8:24	aws-ucws linux	TestAccept/bundle/resources/synced_database_tables/basic/DATABRICKS_BUNDLE_ENGINE=terraform
8:15	aws-ucws linux	TestAccept/bundle/invariant/migrate/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=synced_database_table.yml.tmpl
8:07	azure windows	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
7:27	aws-ucws windows	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=database_instance.yml.tmpl
7:19	azure linux	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
6:50	aws-ucws windows	TestAccept/bundle/invariant/migrate/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=database_instance.yml.tmpl
6:43	aws-ucws windows	TestAccept/bundle/invariant/migrate/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=synced_database_table.yml.tmpl
6:40	aws-ucws linux	TestAccept/bundle/invariant/migrate/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=database_catalog.yml.tmpl
6:35	aws-ucws linux	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=database_instance.yml.tmpl
6:33	aws-ucws linux	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=database_catalog.yml.tmpl
6:30	aws-ucws linux	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
6:24	aws-ucws windows	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=database_catalog.yml.tmpl
6:20	aws-ucws linux	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
6:19	aws-ucws windows	TestAccept/bundle/invariant/migrate/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=database_catalog.yml.tmpl
6:11	aws-ucws linux	TestAccept/bundle/resources/synced_database_tables/basic/DATABRICKS_BUNDLE_ENGINE=direct
5:31	gcp linux	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
5:31	aws-ucws linux	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=synced_database_table.yml.tmpl
5:26	aws-ucws windows	TestAccept/bundle/resources/synced_database_tables/basic/DATABRICKS_BUNDLE_ENGINE=direct
5:25	aws-ucws windows	TestAccept/bundle/resources/synced_database_tables/basic/DATABRICKS_BUNDLE_ENGINE=terraform
5:20	gcp linux	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
5:19	gcp windows	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
5:14	gcp windows	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
4:41	azure-ucws linux	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
4:22	azure-ucws linux	TestAccept/bundle/invariant/migrate/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=database_instance.yml.tmpl
4:15	azure-ucws windows	TestAccept/bundle/invariant/migrate/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=database_instance.yml.tmpl
4:04	azure-ucws windows	TestAccept/bundle/invariant/migrate/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=synced_database_table.yml.tmpl
3:55	azure windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:52	azure linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:52	azure-ucws windows	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
3:51	azure-ucws windows	TestAccept/bundle/invariant/migrate/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=database_catalog.yml.tmpl
3:48	azure-ucws linux	TestAccept/bundle/resources/synced_database_tables/basic/DATABRICKS_BUNDLE_ENGINE=direct
3:48	azure-ucws windows	TestAccept/bundle/resources/synced_database_tables/basic/DATABRICKS_BUNDLE_ENGINE=direct
3:47	azure linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
3:44	azure-ucws linux	TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=no/NBOOK=yes/PY=yes/READPLAN=
3:44	azure-ucws linux	TestAccept/bundle/invariant/migrate/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=synced_database_table.yml.tmpl
3:41	azure-ucws windows	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=database_catalog.yml.tmpl
3:36	azure-ucws windows	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=synced_database_table.yml.tmpl
3:29	azure-ucws linux	TestAccept/bundle/resources/synced_database_tables/basic/DATABRICKS_BUNDLE_ENGINE=terraform
3:18	azure-ucws linux	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=database_catalog.yml.tmpl
3:18	azure-ucws windows	TestAccept/bundle/resources/synced_database_tables/basic/DATABRICKS_BUNDLE_ENGINE=terraform
3:16	aws-ucws linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
3:14	azure-ucws windows	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
3:13	gcp windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:10	azure-ucws linux	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=database_instance.yml.tmpl
3:10	azure-ucws linux	TestAccept/bundle/invariant/migrate/DATABRICKS_BUNDLE_ENGINE=direct/INPUT_CONFIG=database_catalog.yml.tmpl
3:09	azure linux	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
3:07	gcp windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct

shreyas-goenka · 2026-02-05T10:43:46Z

acceptance/dbr_test.go

+//	OR
+//	make dbr-test
+func TestDbrAcceptance(t *testing.T) {
+	if os.Getenv("DBR_ENABLED") != "true" {


DBR tests will run in a separate "env" and will not be a part of normal integration test run. This option enables that.

fix and update test configuration

78bd221

shreyas-goenka changed the title ~~fix and update test configuration~~ Add runner to run tests on DBR Feb 2, 2026

shreyas-goenka added 8 commits February 2, 2026 05:29

add bulk of the runner

51c4429

-

74ad8aa

-

e42ba59

-

24e3fca

Add test runner for DBR

428cac2

update runner

d4da043

fix tests being run

8c87daf

-

8c39b8e

shreyas-goenka temporarily deployed to test-trigger-is February 4, 2026 15:07 — with GitHub Actions Inactive

remove dbr timeout

49ba48d

shreyas-goenka temporarily deployed to test-trigger-is February 4, 2026 15:31 — with GitHub Actions Inactive

Better parsing logic

b10c66f

shreyas-goenka temporarily deployed to test-trigger-is February 4, 2026 15:52 — with GitHub Actions Inactive

remove the gotestsum downloader

8f58e65

shreyas-goenka temporarily deployed to test-trigger-is February 4, 2026 15:56 — with GitHub Actions Inactive

better tests

b59f66e

shreyas-goenka temporarily deployed to test-trigger-is February 4, 2026 16:03 — with GitHub Actions Inactive

add makefile rules for dbr testing

4dbc766

shreyas-goenka temporarily deployed to test-trigger-is February 4, 2026 16:13 — with GitHub Actions Inactive

more cleanup

a8ce3f9

shreyas-goenka temporarily deployed to test-trigger-is February 4, 2026 16:21 — with GitHub Actions Inactive

fix makefile rule

b1defdd

shreyas-goenka temporarily deployed to test-trigger-is February 5, 2026 10:40 — with GitHub Actions Inactive

cleanup dbr_test a bit

e2a0dad

shreyas-goenka temporarily deployed to test-trigger-is February 5, 2026 10:42 — with GitHub Actions Inactive

shreyas-goenka commented Feb 5, 2026

View reviewed changes

print debug logs url before

d4e1d25

shreyas-goenka temporarily deployed to test-trigger-is February 5, 2026 11:33 — with GitHub Actions Inactive

shreyas-goenka changed the title ~~Add runner to run tests on DBR~~ Add runner to run tests on DBR; Use FUSE on DBR for bundel commands Feb 5, 2026

shreyas-goenka changed the title ~~Add runner to run tests on DBR; Use FUSE on DBR for bundel commands~~ Add runner to run tests on DBR Feb 5, 2026

regenerate out.test.toml + add dbr tests

a272cba

shreyas-goenka temporarily deployed to test-trigger-is February 5, 2026 11:47 — with GitHub Actions Inactive

shreyas-goenka mentioned this pull request Feb 5, 2026

Use FUSE for bundle commands on serverless #4450

Draft

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add runner to run tests on DBR#4416

Add runner to run tests on DBR#4416
shreyas-goenka wants to merge 19 commits intomainfrom
dbr-runner-(fuse)

shreyas-goenka commented Feb 2, 2026 •

edited

Loading

Uh oh!

eng-dev-ecosystem-bot commented Feb 4, 2026 •

edited

Loading

Uh oh!

shreyas-goenka Feb 5, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

shreyas-goenka commented Feb 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Changes

Tests

Uh oh!

eng-dev-ecosystem-bot commented Feb 4, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

shreyas-goenka Feb 5, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

shreyas-goenka commented Feb 2, 2026 •

edited

Loading

eng-dev-ecosystem-bot commented Feb 4, 2026 •

edited

Loading