SSH: refactor Jupyter init script to use better Spark session initialization flow by ilia-db · Pull Request #4645 · databricks/cli

ilia-db · 2026-03-03T15:51:49Z

Changes

Always use UserNamespaceInitializer do initialize global jupyter variables (sql, table, display, etc), even in serverless context.
Always use Databricks Connect to initialize spark, even on dedicated clusters (where we point it to the cluster itself).

Why

We've had different path for serverless spark before, where we didn't use UserNamespaceInitializer, which was not ideal, since the global jupyter scope for serverless and dedicated was different because of that.

The reason to use Databricks Connect on dedicated cluster is to expose the same spark connect API in all environments, avoiding compatibility issues. Local spark has access to some internal jvm APIs, which are not available in spark connect mode, but the rest is the same.

Tests

Manually and existing e2e tests

eng-dev-ecosystem-bot · 2026-03-03T16:06:19Z

Commit: 1a6d44a

Run: 22723494258

	Env	🪲BUG	❌FAIL	🟨KNOWN	🔄flaky	💚RECOVERED	🙈SKIP	✅pass	🙈skip	Time
💚	aws linux					8	7	268	779	8:45
💚	aws windows					8	7	270	777	5:59
🔄	aws-ucws linux				2	7	7	364	694	11:38
🔄	aws-ucws windows				2	7	7	366	692	7:51
🪲	azure linux	1	8	1		1	9	262	777	146:15
🪲	azure windows	1	8	1		1	9	264	775	145:02
🪲	azure-ucws linux	1	8	1	2		9	360	690	149:36
🪲	azure-ucws windows	1	8	1	1	1	9	362	688	147:06
🪲	gcp linux	1	8	1		1	9	258	780	145:14
🪲	gcp windows	1	8	1		1	9	260	778	145:12

25 interesting tests: 8 FAIL, 7 SKIP, 6 RECOVERED, 2 flaky, 1 KNOWN, 1 BUG

	Test Name	aws linux	aws windows	aws-ucws linux	aws-ucws windows	azure linux	azure windows	azure-ucws linux	azure-ucws windows	gcp linux	gcp windows
🟨	TestAccept	💚R	💚R	💚R	💚R	🟨K	🟨K	🟨K	🟨K	🟨K	🟨K
🪲	TestAccept/bundle/deployment/bind/alert	🙈s	🙈s	🙈s	🙈s	🪲B	🪲B	🪲B	🪲B	🪲B	🪲B
❌	TestAccept/bundle/deployment/bind/alert/DATABRICKS_BUNDLE_ENGINE=direct					❌F	❌F	❌F	❌F	❌F	❌F
❌	TestAccept/bundle/deployment/bind/alert/DATABRICKS_BUNDLE_ENGINE=terraform					❌F	❌F	❌F	❌F	❌F	❌F
❌	TestAccept/bundle/generate/alert	✅p	✅p	✅p	✅p	❌F	❌F	❌F	❌F	❌F	❌F
❌	TestAccept/bundle/generate/alert/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	❌F	❌F	❌F	❌F	❌F	❌F
❌	TestAccept/bundle/generate/alert/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	❌F	❌F	❌F	❌F	❌F	❌F
❌	TestAccept/bundle/resources/alerts/with_file	✅p	✅p	✅p	✅p	❌F	❌F	❌F	❌F	❌F	❌F
❌	TestAccept/bundle/resources/alerts/with_file/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	❌F	❌F	❌F	❌F	❌F	❌F
❌	TestAccept/bundle/resources/alerts/with_file/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	❌F	❌F	❌F	❌F	❌F	❌F
🙈	TestAccept/bundle/resources/permissions	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
💚	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions	💚R	💚R	💚R	💚R	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
💚	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=direct	💚R	💚R	💚R	💚R
💚	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=terraform	💚R	💚R	💚R	💚R
💚	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions	💚R	💚R	💚R	💚R	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
💚	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=direct	💚R	💚R	💚R	💚R
💚	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=terraform	💚R	💚R	💚R	💚R
🙈	TestAccept/bundle/resources/postgres_branches/basic	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_branches/recreate	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_branches/update_protected	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_branches/without_branch_id	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_endpoints/recreate	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/synced_database_tables/basic	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🔄	TestAccept/ssh/connect-serverless-gpu	🙈s	🙈s	🔄f	🔄f	🙈s	🙈s	🔄f	🔄f	🙈s	🙈s
🔄	TestAccept/ssh/connection	💚R	💚R	🔄f	🔄f	💚R	💚R	🔄f	💚R	💚R	💚R

Top 21 slowest tests (at least 2 minutes):

duration	env	testname
5:35	azure-ucws windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
5:34	aws-ucws linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
4:50	aws-ucws linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
4:45	azure windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
4:29	azure-ucws windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
4:20	aws linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
4:08	aws-ucws windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:50	azure-ucws linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:50	azure-ucws linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
3:46	azure linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
3:42	aws-ucws windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
3:39	gcp linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
3:20	gcp windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:19	gcp linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:14	gcp windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
3:11	aws windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:05	aws windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:58	aws linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:26	aws linux	TestAccept
2:20	azure windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:14	azure linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform

…on flow

eng-dev-ecosystem-bot · 2026-03-05T23:01:25Z

Commit: 6357294

Run: 22730760743

	Env	🪲BUG	❌FAIL	🟨KNOWN	🔄flaky	💚RECOVERED	🙈SKIP	✅pass	🙈skip	Time
❌	aws linux		1	1		7	7	493	733	55:11
❌	aws windows		1	1		7	7	465	741	54:26
🔄	aws-ucws linux				3	24	1	759	581	96:22
🔄	aws-ucws windows				3	23	1	723	592	82:09
🪲	azure linux	1	12	1		1	9	484	731	238:12
🪲	azure windows	1	12	1		1	9	456	739	233:44
🪲	azure-ucws linux	1	11	1		4	8	728	586	261:35
🪲	azure-ucws windows	1	11	1		4	8	691	597	260:20
🪲	gcp linux	1	12	1		1	9	467	739	236:43
🪲	gcp windows	1	22	1		1	9	429	747	76:40

52 interesting tests: 23 RECOVERED, 22 FAIL, 4 flaky, 1 KNOWN, 1 BUG, 1 SKIP

	Test Name	aws linux	aws windows	aws-ucws linux	aws-ucws windows	azure linux	azure windows	azure-ucws linux	azure-ucws windows	gcp linux	gcp windows
🟨	TestAccept	🟨K	🟨K	💚R	🔄f	🟨K	🟨K	🟨K	🟨K	🟨K	🟨K
❌	TestAccept/bundle/apps/job_permissions	❌F	❌F	🔄f	✅p	❌F	❌F	✅p	✅p	❌F	❌F
🪲	TestAccept/bundle/deployment/bind/alert	🙈s	🙈s	🙈s	🙈s	🪲B	🪲B	🪲B	🪲B	🪲B	🪲B
❌	TestAccept/bundle/deployment/bind/alert/DATABRICKS_BUNDLE_ENGINE=direct					❌F	❌F	❌F	❌F	❌F	❌F
❌	TestAccept/bundle/deployment/bind/alert/DATABRICKS_BUNDLE_ENGINE=terraform					❌F	❌F	❌F	❌F	❌F	❌F
❌	TestAccept/bundle/deployment/bind/dashboard	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/deployment/bind/dashboard/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/deployment/bind/job/job-abort-bind	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/deployment/bind/job/job-abort-bind/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/deployment/bind/model-serving-endpoint	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/deployment/bind/model-serving-endpoint/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/destroy/jobs-and-pipeline	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/destroy/jobs-and-pipeline/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/generate/alert	✅p	✅p	✅p	✅p	❌F	❌F	❌F	❌F	❌F	❌F
❌	TestAccept/bundle/generate/alert/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	❌F	❌F	❌F	❌F	❌F	❌F
❌	TestAccept/bundle/generate/alert/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	❌F	❌F	❌F	❌F	❌F	❌F
❌	TestAccept/bundle/resources/alerts/basic	✅p	✅p	✅p	✅p	❌F	❌F	❌F	❌F	❌F	❌F
❌	TestAccept/bundle/resources/alerts/basic/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	❌F	❌F	❌F	❌F	❌F	❌F
❌	TestAccept/bundle/resources/alerts/basic/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	❌F	❌F	❌F	❌F	❌F	❌F
❌	TestAccept/bundle/resources/alerts/with_file	✅p	✅p	✅p	✅p	❌F	❌F	❌F	❌F	❌F	❌F
❌	TestAccept/bundle/resources/alerts/with_file/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	❌F	❌F	❌F	❌F	❌F	❌F
❌	TestAccept/bundle/resources/alerts/with_file/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	❌F	❌F	❌F	❌F	❌F	❌F
❌	TestAccept/bundle/resources/dashboards/destroy	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/resources/dashboards/destroy/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F
🙈	TestAccept/bundle/resources/permissions	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
💚	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions	💚R	💚R	💚R	💚R	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
💚	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=direct	💚R	💚R	💚R	💚R
💚	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=terraform	💚R	💚R	💚R	💚R
💚	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions	💚R	💚R	💚R	💚R	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
💚	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=direct	💚R	💚R	💚R	💚R
💚	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=terraform	💚R	💚R	💚R	💚R
💚	TestAccept/bundle/resources/postgres_branches/basic	🙈S	🙈S	💚R	💚R	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
💚	TestAccept/bundle/resources/postgres_branches/basic/DATABRICKS_BUNDLE_ENGINE=direct			💚R	💚R
💚	TestAccept/bundle/resources/postgres_branches/basic/DATABRICKS_BUNDLE_ENGINE=terraform			💚R	💚R
💚	TestAccept/bundle/resources/postgres_branches/recreate	🙈S	🙈S	💚R	💚R	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
💚	TestAccept/bundle/resources/postgres_branches/recreate/DATABRICKS_BUNDLE_ENGINE=direct			💚R	💚R
💚	TestAccept/bundle/resources/postgres_branches/recreate/DATABRICKS_BUNDLE_ENGINE=terraform			💚R	💚R
💚	TestAccept/bundle/resources/postgres_branches/update_protected	🙈S	🙈S	💚R	💚R	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
💚	TestAccept/bundle/resources/postgres_branches/update_protected/DATABRICKS_BUNDLE_ENGINE=direct			💚R	💚R
💚	TestAccept/bundle/resources/postgres_branches/update_protected/DATABRICKS_BUNDLE_ENGINE=terraform			💚R	💚R
💚	TestAccept/bundle/resources/postgres_branches/without_branch_id	🙈S	🙈S	💚R	💚R	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
💚	TestAccept/bundle/resources/postgres_branches/without_branch_id/DATABRICKS_BUNDLE_ENGINE=direct			💚R	💚R
💚	TestAccept/bundle/resources/postgres_branches/without_branch_id/DATABRICKS_BUNDLE_ENGINE=terraform			💚R	💚R
🔄	TestAccept/bundle/resources/postgres_endpoints/basic	🙈s	🙈s	✅p	🔄f	🙈s	🙈s	🙈s	🙈s	🙈s	🙈s
🔄	TestAccept/bundle/resources/postgres_endpoints/basic/DATABRICKS_BUNDLE_ENGINE=terraform			✅p	🔄f
💚	TestAccept/bundle/resources/postgres_endpoints/recreate	🙈S	🙈S	💚R	💚R	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🔄	TestAccept/bundle/resources/postgres_projects/basic	🙈s	🙈s	🔄f	✅p	🙈s	🙈s	🙈s	🙈s	🙈s	🙈s
🔄	TestAccept/bundle/resources/postgres_projects/basic/DATABRICKS_BUNDLE_ENGINE=direct			🔄f	✅p
💚	TestAccept/bundle/resources/synced_database_tables/basic	🙈S	🙈S	💚R	💚R	🙈S	🙈S	💚R	💚R	🙈S	🙈S
💚	TestAccept/bundle/resources/synced_database_tables/basic/DATABRICKS_BUNDLE_ENGINE=direct			💚R	💚R			💚R	💚R
💚	TestAccept/bundle/resources/synced_database_tables/basic/DATABRICKS_BUNDLE_ENGINE=terraform			💚R	💚R			💚R	💚R
💚	TestAccept/ssh/connection	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R

Top 50 slowest tests (at least 2 minutes):

duration	env	testname
15:17	gcp windows	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=terraform
11:28	gcp windows	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=terraform/DATA_SECURITY_MODE=SINGLE_USER
11:00	aws windows	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=terraform
10:54	aws-ucws windows	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=terraform
10:44	aws-ucws linux	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=terraform
10:32	aws-ucws linux	TestAccept/bundle/resources/model_serving_endpoints/running-endpoint/DATABRICKS_BUNDLE_ENGINE=terraform
10:30	gcp linux	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=terraform
10:20	gcp linux	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=terraform/DATA_SECURITY_MODE=SINGLE_USER
10:08	gcp windows	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=direct
9:46	gcp windows	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=terraform
9:35	aws linux	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=terraform
9:26	gcp linux	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=direct
9:25	gcp windows	TestAccept/bundle/run/app-with-job/DATABRICKS_BUNDLE_ENGINE=direct
9:25	azure windows	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=terraform
9:23	gcp linux	TestAccept/bundle/run/app-with-job/DATABRICKS_BUNDLE_ENGINE=terraform
9:22	azure linux	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=terraform
9:08	azure-ucws windows	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=terraform
9:02	gcp windows	TestSparkJarTaskDeployAndRunOnWorkspace/Databricks_Runtime_15.4_LTS
9:02	azure-ucws windows	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=terraform/DATA_SECURITY_MODE=SINGLE_USER
8:55	aws linux	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=direct
8:54	aws-ucws linux	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=direct
8:47	gcp windows	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=terraform/DATA_SECURITY_MODE=USER_ISOLATION
8:44	gcp linux	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=terraform/DATA_SECURITY_MODE=USER_ISOLATION
8:44	gcp windows	TestAccept/bundle/integration_whl/interactive_cluster/DATABRICKS_BUNDLE_ENGINE=terraform
8:42	aws windows	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=terraform
8:41	gcp linux	TestSparkJarTaskDeployAndRunOnWorkspace/Databricks_Runtime_14.3_LTS
8:40	gcp linux	TestSparkJarTaskDeployAndRunOnWorkspace/Databricks_Runtime_15.4_LTS
8:39	gcp linux	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=direct/DATA_SECURITY_MODE=USER_ISOLATION
8:38	aws windows	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=direct
8:33	gcp windows	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=direct/DATA_SECURITY_MODE=USER_ISOLATION
8:33	gcp linux	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=terraform
8:32	gcp windows	TestSparkJarTaskDeployAndRunOnWorkspace/Databricks_Runtime_14.3_LTS
8:27	aws linux	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=direct/DATA_SECURITY_MODE=USER_ISOLATION
8:26	azure-ucws linux	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=terraform
8:26	aws-ucws windows	TestAccept/bundle/resources/model_serving_endpoints/running-endpoint/DATABRICKS_BUNDLE_ENGINE=direct
8:26	aws windows	TestAccept/bundle/integration_whl/custom_params/DATABRICKS_BUNDLE_ENGINE=terraform
8:22	azure-ucws linux	TestSparkJarTaskDeployAndRunOnVolumes/Databricks_Runtime_13.3_LTS
8:21	gcp linux	TestAccept/bundle/run/app-with-job/DATABRICKS_BUNDLE_ENGINE=direct
8:19	aws-ucws windows	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=terraform/DATA_SECURITY_MODE=USER_ISOLATION
8:13	azure-ucws linux	TestSparkJarTaskDeployAndRunOnVolumes/Databricks_Runtime_14.3_LTS
8:13	azure-ucws windows	TestSparkJarTaskDeployAndRunOnVolumes/Databricks_Runtime_15.4_LTS
8:12	aws-ucws linux	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=terraform/DATA_SECURITY_MODE=USER_ISOLATION
8:12	aws-ucws windows	TestAccept/bundle/resources/model_serving_endpoints/running-endpoint/DATABRICKS_BUNDLE_ENGINE=terraform
8:12	azure-ucws windows	TestSparkJarTaskDeployAndRunOnVolumes/Databricks_Runtime_13.3_LTS
8:09	gcp windows	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=direct
8:09	gcp windows	TestAccept/bundle/integration_whl/interactive_cluster/DATABRICKS_BUNDLE_ENGINE=direct
8:08	aws-ucws linux	TestAccept/bundle/resources/database_instances/single-instance/DATABRICKS_BUNDLE_ENGINE=direct
8:05	aws windows	TestSparkJarTaskDeployAndRunOnWorkspace/Databricks_Runtime_15.4_LTS
8:04	aws-ucws linux	TestAccept/bundle/run/app-with-job/DATABRICKS_BUNDLE_ENGINE=terraform
7:58	aws linux	TestSparkJarTaskDeployAndRunOnWorkspace/Databricks_Runtime_15.4_LTS

ilia-db temporarily deployed to test-trigger-is March 3, 2026 15:52 — with GitHub Actions Inactive

ilia-db temporarily deployed to test-trigger-is March 3, 2026 16:09 — with GitHub Actions Inactive

ilia-db temporarily deployed to test-trigger-is March 5, 2026 14:38 — with GitHub Actions Inactive

ilia-db temporarily deployed to test-trigger-is March 5, 2026 14:50 — with GitHub Actions Inactive

ilia-db added 4 commits March 5, 2026 15:50

Refactor Jupyter init script to use better Spark session initializati…

f45c6e2

…on flow

Fix globals and pip_magic registration

bab7b6a

Initialize spark session with Databricks Connect in all modes

d74b229

Fmt fix

1a6d44a

ilia-db force-pushed the ssh-tunnel-spark-sessions branch from cdb52e9 to 1a6d44a Compare March 5, 2026 14:51

ilia-db temporarily deployed to test-trigger-is March 5, 2026 14:51 — with GitHub Actions Inactive

ilia-db marked this pull request as ready for review March 5, 2026 14:52

ilia-db requested review from andrewnester, anton-107, denik, pietern, shreyas-goenka and simonfaltum as code owners March 5, 2026 14:52

anton-107 approved these changes Mar 5, 2026

View reviewed changes

ilia-db merged commit 6357294 into main Mar 5, 2026
14 of 15 checks passed

ilia-db deleted the ssh-tunnel-spark-sessions branch March 5, 2026 18:26

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

SSH: refactor Jupyter init script to use better Spark session initialization flow#4645

SSH: refactor Jupyter init script to use better Spark session initialization flow#4645
ilia-db merged 4 commits intomainfrom
ssh-tunnel-spark-sessions

ilia-db commented Mar 3, 2026 •

edited

Loading

Uh oh!

eng-dev-ecosystem-bot commented Mar 3, 2026 •

edited

Loading

Uh oh!

Uh oh!

eng-dev-ecosystem-bot commented Mar 5, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Conversation

ilia-db commented Mar 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Changes

Why

Tests

Uh oh!

eng-dev-ecosystem-bot commented Mar 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

eng-dev-ecosystem-bot commented Mar 5, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

ilia-db commented Mar 3, 2026 •

edited

Loading

eng-dev-ecosystem-bot commented Mar 3, 2026 •

edited

Loading