Version 0.232.0 breaks databricks asset bundle deploy - Path(<bundle_path>/resources) doesn't exist

[NodeJSmith]

Describe the issue

When deploying a databricks asset bundle with v0.232.0 the deployment fails with an exception that Error: Path (/Shared/.bundle/legacy/dev/resources) doesn't exist. This does not happen on earlier versions.

at 12:22:42 ❯ ~/databricks_cli_0.232.0_linux_amd64/databricks bundle deploy --target dev
Building dbx_pipeline_legacy...
Uploading dbx_pipeline_legacy-20241030.122358-py3-none-any.whl...
Uploading bundle files to /Workspace/Shared/.bundle/legacy/dev/files...
Warning: the bundle root path /Workspace/Shared/.bundle/legacy/dev is writable by all workspace users

The bundle is configured to use /Workspace/Shared, which will give read/write access to all users. If this is intentional, add CAN_MANAGE for 'group_name: users' permission to your bundle configuration. If the deployment should be restricted, move it to a restricted folder such as /Workspace/Users/<username or principal name>.

Error: Path (/Shared/.bundle/legacy/dev/resources) doesn't exist.

Steps to reproduce the behavior

Create a databricks.yml file, run databricks bundle deploy

Expected Behavior

The bundle should be deploy without any issues

at 12:30:17 ❯ ~/databricks_cli_0.231.0_linux_amd64/databricks bundle deploy --target dev                         
Building dbx_pipeline_legacy...
Uploading dbx_pipeline_legacy-20241030.123539-py3-none-any.whl...
Uploading bundle files to /Workspace/Shared/.bundle/legacy/dev/files...
Deploying resources...
Updating deployment state...
Deployment complete!
Warning: the bundle root path /Workspace/Shared/.bundle/legacy/dev is writable by all workspace users

The bundle is configured to use /Workspace/Shared, which will give read/write access to all users. If this is intentional, add CAN_MANAGE for 'group_name: users' permission to your bundle configuration. If the deployment should be restricted, move it to a restricted folder such as /Workspace/Users/<username or principal name>.

Actual Behavior

at 12:22:42 ❯ ~/databricks_cli_0.232.0_linux_amd64/databricks bundle deploy --target dev
Building dbx_pipeline_legacy...
Uploading dbx_pipeline_legacy-20241030.122358-py3-none-any.whl...
Uploading bundle files to /Workspace/Shared/.bundle/legacy/dev/files...
Warning: the bundle root path /Workspace/Shared/.bundle/legacy/dev is writable by all workspace users

The bundle is configured to use /Workspace/Shared, which will give read/write access to all users. If this is intentional, add CAN_MANAGE for 'group_name: users' permission to your bundle configuration. If the deployment should be restricted, move it to a restricted folder such as /Workspace/Users/<username or principal name>.

Error: Path (/Shared/.bundle/legacy/dev/resources) doesn't exist.

OS and CLI version

CLI version = v0.232.0
OS - Ubuntu 22.04, on WSL 2 - Windows 10

Is this a regression?

Yes, this worked on v0.231.0 and prior

Debug Logs

12:30:11  INFO start pid=1863989 version=0.232.0 args="/home/jessica/databricks_cli_0.232.0_linux_amd64/databricks, bundle, deploy, --target, dev, --debug"
12:30:11 DEBUG Found bundle root at /home/jessica/source/company_name/dbx-pipeline-legacy (file /home/jessica/source/company_name/dbx-pipeline-legacy/databricks.yml) pid=1863989
12:30:11 DEBUG Apply pid=1863989 mutator=load
12:30:11  INFO Phase: load pid=1863989 mutator=load
12:30:11 DEBUG Apply pid=1863989 mutator=load mutator=seq
12:30:11 DEBUG Apply pid=1863989 mutator=load mutator=seq mutator=EntryPoint
12:30:11 DEBUG Apply pid=1863989 mutator=load mutator=seq mutator=scripts.preinit
12:30:11 DEBUG No script defined for preinit, skipping pid=1863989 mutator=load mutator=seq mutator=scripts.preinit
12:30:11 DEBUG Apply pid=1863989 mutator=load mutator=seq mutator=ProcessRootIncludes
12:30:11 DEBUG Apply pid=1863989 mutator=load mutator=seq mutator=ProcessRootIncludes mutator=seq
12:30:11 DEBUG Apply pid=1863989 mutator=load mutator=seq mutator=VerifyCliVersion
12:30:11 DEBUG Apply pid=1863989 mutator=load mutator=seq mutator=EnvironmentsToTargets
12:30:11 DEBUG Apply pid=1863989 mutator=load mutator=seq mutator=ComputeIdToClusterId
12:30:11 DEBUG Apply pid=1863989 mutator=load mutator=seq mutator=InitializeVariables
12:30:11 DEBUG Apply pid=1863989 mutator=load mutator=seq mutator=DefineDefaultTarget(default)
12:30:11 DEBUG Apply pid=1863989 mutator=load mutator=seq mutator=LoadGitDetails
12:30:11 DEBUG Apply pid=1863989 mutator=load mutator=seq mutator=PythonMutator(load)
12:30:11 DEBUG Apply pid=1863989 mutator=load mutator=seq mutator=validate:unique_resource_keys
12:30:11 DEBUG Apply pid=1863989 mutator=load mutator=seq mutator=SelectTarget(dev)
12:30:11 DEBUG Apply pid=1863989 mutator=<func>
12:30:11 DEBUG Apply pid=1863989 mutator=<func>
12:30:11 DEBUG Apply pid=1863989 mutator=seq
12:30:11 DEBUG Apply pid=1863989 mutator=seq mutator=initialize
12:30:11  INFO Phase: initialize pid=1863989 mutator=seq mutator=initialize
12:30:11 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq
12:30:11 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=validate:AllResourcesHaveValues
12:30:11 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=RewriteSyncPaths
12:30:11 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=SyncDefaultPath
12:30:11 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=SyncInferRoot
12:30:11 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=MergeJobClusters
12:30:11 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=MergeJobParameters
12:30:11 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=MergeJobTasks
12:30:11 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=MergePipelineClusters
12:30:11 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=InitializeWorkspaceClient
12:30:11 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=PopulateCurrentUser
12:30:12 DEBUG GET /api/2.0/preview/scim/v2/Me
< HTTP/2.0 200 OK
< {
<   "active": true,
<   "displayName": "Jessica Smith",
<   "emails": [
<     {
<       "primary": true,
<       "type": "work",
<       "value": "jessica.smith@companyemail.com"
<     }
<   ],
<   "groups": [
<     {
<       "$ref": "Groups/XXXXXXXXX",
<       "display": "Data Platform",
<       "type": "direct",
<       "value": "XXXXXXXXX"
<     },
<     {
<       "$ref": "Groups/XXXXXXXXX",
<       "display": "MetastoreAdmin",
<       "type": "direct",
<       "value": "XXXXXXXXX"
<     },
<     {
<       "$ref": "Groups/XXXXXXXXX",
<       "display": "Data Engineering",
<       "type": "direct",
<       "value": "XXXXXXXXX"
<     },
<     {
<       "$ref": "Groups/XXXXXXXXX",
<       "display": "admins",
<       "type": "indirect",
<       "value": "XXXXXXXXX"
<     }
<   ],
<   "id": "1919711809923591",
<   "name": {
<     "familyName": "Smith",
<     "givenName": "Jessica"
<   },
<   "roles": [
<     {
<       "value": "arn:aws:iam::XXXXXXXXXXX:instance-profile/DatabricksAccess"
<     }
<   ],
<   "schemas": [
<     "urn:ietf:params:scim:schemas:core:2.0:User",
<     "urn:ietf:params:scim:schemas:extension:workspace:2.0:User"
<   ],
<   "userName": "jessica.smith@companyemail.com"
< } pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=PopulateCurrentUser sdk=true
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=DefineDefaultWorkspaceRoot
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=ExpandWorkspaceRoot
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=DefaultWorkspacePaths
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=PrependWorkspacePrefix
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=RewriteWorkspacePrefix
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=SetVariables
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=PythonMutator(init)
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=ResolveVariableReferences
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=ResolveResourceReferences
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=ResolveVariableReferences
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=ResolveVariableReferences
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=CheckPermissions
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=SetRunAs
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=OverrideCompute
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=ConfigureDashboardDefaults
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=ProcessTargetMode
12:30:12  WARN target with 'mode: production' should specify an explicit 'targets.dev.git' configuration pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=ProcessTargetMode
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=ApplyPresets
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=DefaultQueueing
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=ExpandPipelineGlobPaths
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=ConfigureWSFS
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=TranslatePaths
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=PythonWrapperWarning
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=ValidateSharedRootPermissions
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=ApplyBundlePermissions
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=FilterCurrentUserFromPermissions
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=metadata.AnnotateJobs
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=metadata.AnnotatePipelines
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=terraform.Initialize
12:30:12 DEBUG DATABRICKS_TF_EXEC_PATH is not defined pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=terraform.Initialize
12:30:12 DEBUG Using Terraform at /home/jessica/source/company_name/dbx-pipeline-legacy/.databricks/bundle/dev/bin/terraform pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=terraform.Initialize
12:30:12 DEBUG DATABRICKS_TF_CLI_CONFIG_FILE is not defined pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=terraform.Initialize
12:30:12 DEBUG Environment variables for Terraform: DATABRICKS_HOST, DATABRICKS_CLUSTER_ID, DATABRICKS_TOKEN, DATABRICKS_CLI_PATH, DATABRICKS_AUTH_TYPE, HOME, PATH, DATABRICKS_USER_AGENT_EXTRA pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=terraform.Initialize
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=scripts.postinit
12:30:12 DEBUG No script defined for postinit, skipping pid=1863989 mutator=seq mutator=initialize mutator=seq mutator=scripts.postinit
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=build
12:30:12  INFO Phase: build pid=1863989 mutator=seq mutator=build
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=build mutator=seq
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=build mutator=seq mutator=scripts.prebuild
12:30:12 DEBUG No script defined for prebuild, skipping pid=1863989 mutator=seq mutator=build mutator=seq mutator=scripts.prebuild
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=build mutator=seq mutator=artifacts.DetectPackages
12:30:12 DEBUG artifacts block is defined, skipping auto-detecting pid=1863989 mutator=seq mutator=build mutator=seq mutator=artifacts.DetectPackages
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=build mutator=seq mutator=artifacts.inferAll
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=build mutator=seq mutator=artifacts.inferAll mutator=seq
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=build mutator=seq mutator=artifacts.inferAll mutator=seq mutator=artifacts.Infer(dbx_pipeline_legacy)
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=build mutator=seq mutator=artifacts.inferAll mutator=seq mutator=artifacts.Infer(dbx_pipeline_legacy) mutator=artifacts.whl.Infer(dbx_pipeline_legacy)
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=build mutator=seq mutator=artifacts.PrepareAll
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=build mutator=seq mutator=artifacts.PrepareAll mutator=seq
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=build mutator=seq mutator=artifacts.PrepareAll mutator=seq mutator=artifacts.Prepare(dbx_pipeline_legacy)
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=build mutator=seq mutator=artifacts.PrepareAll mutator=seq mutator=artifacts.Prepare(dbx_pipeline_legacy) mutator=artifacts.whl.Prepare(dbx_pipeline_legacy)
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=build mutator=seq mutator=artifacts.BuildAll
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=build mutator=seq mutator=artifacts.BuildAll mutator=seq
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=build mutator=seq mutator=artifacts.BuildAll mutator=seq mutator=artifacts.Build(dbx_pipeline_legacy)
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=build mutator=seq mutator=artifacts.BuildAll mutator=seq mutator=artifacts.Build(dbx_pipeline_legacy) mutator=seq
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=build mutator=seq mutator=artifacts.BuildAll mutator=seq mutator=artifacts.Build(dbx_pipeline_legacy) mutator=seq mutator=artifacts.whl.Build(dbx_pipeline_legacy)
Building dbx_pipeline_legacy...
12:30:12  INFO Build succeeded pid=1863989 mutator=seq mutator=build mutator=seq mutator=artifacts.BuildAll mutator=seq mutator=artifacts.Build(dbx_pipeline_legacy) mutator=seq mutator=artifacts.whl.Build(dbx_pipeline_legacy)
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=build mutator=seq mutator=artifacts.BuildAll mutator=seq mutator=artifacts.Build(dbx_pipeline_legacy) mutator=seq mutator=artifacts.ExpandGlobs(dbx_pipeline_legacy)
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=build mutator=seq mutator=scripts.postbuild
12:30:12 DEBUG No script defined for postbuild, skipping pid=1863989 mutator=seq mutator=build mutator=seq mutator=scripts.postbuild
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=build mutator=seq mutator=ResolveVariableReferences
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=deploy
12:30:12  INFO Phase: deploy pid=1863989 mutator=seq mutator=deploy
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=deploy mutator=seq
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=scripts.predeploy
12:30:12 DEBUG No script defined for predeploy, skipping pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=scripts.predeploy
12:30:12 DEBUG Apply pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=lock:acquire
12:30:12  INFO Acquiring deployment lock (force: false) pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=lock:acquire
12:30:12 DEBUG POST /api/2.0/workspace-files/import-file/Workspace/Shared/.bundle/legacy/dev/state/deploy.lock?overwrite=false
> {
>   "AcquisitionTime": "2024-10-30T12:30:12.293725076-05:00",
>   "ID": "b3a848bb-cc33-4882-b0a7-34f5caa154a6",
>   "IsForced": false,
>   "User": "jessica.smith@companyemail.com"
> }
< HTTP/2.0 200 OK pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=lock:acquire sdk=true
12:30:12 DEBUG GET /api/2.0/workspace/get-status?path=/Workspace/Shared/.bundle/legacy/dev/state/deploy.lock&return_export_info=true
< HTTP/2.0 200 OK
< {
<   "created_at": 1730309413295,
<   "modified_at": 1730309413295,
<   "object_id": 3057758101523416,
<   "object_type": "FILE",
<   "path": "/Workspace/Shared/.bundle/legacy/dev/state/deploy.lock",
<   "resource_id": "3057758101523416"
< } pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=lock:acquire sdk=true
12:30:13 DEBUG GET /api/2.0/workspace/export?direct_download=true&path=/Workspace/Shared/.bundle/legacy/dev/state/deploy.lock
< HTTP/2.0 200 OK
< <Streaming response> pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=lock:acquire sdk=true
12:30:13 DEBUG Apply pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred
12:30:13 DEBUG Apply pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq
12:30:13 DEBUG Apply pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=terraform:state-pull
12:30:14 DEBUG GET /api/2.0/workspace/get-status?path=/Workspace/Shared/.bundle/legacy/dev/state/terraform.tfstate&return_export_info=true
< HTTP/2.0 200 OK
< {
<   "created_at": 1724257154470,
<   "modified_at": 1730309102178,
<   "object_id": 4097500278121851,
<   "object_type": "FILE",
<   "path": "/Workspace/Shared/.bundle/legacy/dev/state/terraform.tfstate",
<   "resource_id": "4097500278121851"
< } pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=terraform:state-pull sdk=true
12:30:14 DEBUG GET /api/2.0/workspace/export?direct_download=true&path=/Workspace/Shared/.bundle/legacy/dev/state/terraform.tfstate
< HTTP/2.0 200 OK
< <Streaming response> pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=terraform:state-pull sdk=true
12:30:14 DEBUG Apply pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=CheckDashboardsModifiedRemotely
12:30:14 DEBUG Apply pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=deploy:state-pull
12:30:14  INFO Opening remote deployment state file pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=deploy:state-pull
12:30:14 DEBUG GET /api/2.0/workspace/get-status?path=/Workspace/Shared/.bundle/legacy/dev/state/deployment.json&return_export_info=true
< HTTP/2.0 200 OK
< {
<   "created_at": 1724257149485,
<   "modified_at": 1730309359943,
<   "object_id": 4097500278121850,
<   "object_type": "FILE",
<   "path": "/Workspace/Shared/.bundle/legacy/dev/state/deployment.json",
<   "resource_id": "4097500278121850"
< } pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=deploy:state-pull sdk=true
12:30:14 DEBUG GET /api/2.0/workspace/export?direct_download=true&path=/Workspace/Shared/.bundle/legacy/dev/state/deployment.json
< HTTP/2.0 200 OK
< <Streaming response> pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=deploy:state-pull sdk=true
12:30:14  INFO Local deployment state is the same or newer, ignoring remote state pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=deploy:state-pull
12:30:14 DEBUG Apply pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=ValidateGitDetails
12:30:14 DEBUG Apply pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=artifacts.CleanUp
12:30:14 ERROR failed to delete /Workspace/Shared/.bundle/legacy/dev/artifacts/.internal: unable to delete filer root pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=artifacts.CleanUp
12:30:14 DEBUG POST /api/2.0/workspace/mkdirs
> {
>   "path": "/Workspace/Shared/.bundle/legacy/dev/artifacts/.internal"
> }
< HTTP/2.0 200 OK
< {} pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=artifacts.CleanUp sdk=true
12:30:14 DEBUG Apply pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=libraries.ExpandGlobReferences
12:30:14 DEBUG Apply pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=libraries.Upload
Uploading dbx_pipeline_legacy-20241030.123012-py3-none-any.whl...
12:30:15 DEBUG POST /api/2.0/workspace-files/import-file/Workspace/Shared/.bundle/legacy/dev/artifacts/.internal/dbx_pipeline_legacy-20241030.123012-py3-none-any.whl?overwrite=true
> PK<���
> ��yW>dbx_pipeline_legacy/__init__.pyK+��UHI,I-��MU��-�/*�����R��3����... (45474 more bytes)
< HTTP/2.0 200 OK pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=libraries.Upload sdk=true
12:30:15  INFO Upload succeeded pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=libraries.Upload
12:30:15 DEBUG Apply pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=If
12:30:15 DEBUG Apply pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=If mutator=NoOp
12:30:15 DEBUG Apply pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=files.Upload
Uploading bundle files to /Workspace/Shared/.bundle/legacy/dev/files...
12:30:15 DEBUG GET /api/2.0/workspace/get-status?path=/Workspace/Shared/.bundle/legacy/dev/files
< HTTP/2.0 200 OK
< {
<   "object_id": 4097500278121780,
<   "object_type": "DIRECTORY",
<   "path": "/Workspace/Shared/.bundle/legacy/dev/files",
<   "resource_id": "4097500278121780"
< } pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=files.Upload sdk=true
12:30:15 DEBUG Path /Workspace/Shared/.bundle/legacy/dev/files has type directory (ID: 4097500278121780) pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=files.Upload
12:30:16 DEBUG POST /api/2.0/workspace-files/import-file/Workspace/Shared/.bundle/legacy/dev/files/logs.txt?overwrite=true
> 12:30:11  INFO start pid=1863989 version=0.232.0 args="/home/jessica/databricks_cli_0.232.0_linu... (19432 more bytes)
< HTTP/2.0 200 OK pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=files.Upload sdk=true
12:30:16  INFO Uploaded bundle files pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=files.Upload
12:30:16 DEBUG Apply pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=deploy:state-update
12:30:16  INFO Loading deployment state from /home/jessica/source/company_name/dbx-pipeline-legacy/.databricks/bundle/dev/deployment.json pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=deploy:state-update
12:30:16 DEBUG Apply pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=deploy:state-push
12:30:16  INFO Writing local deployment state file to remote state directory pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=deploy:state-push
12:30:16 DEBUG POST /api/2.0/workspace-files/import-file/Workspace/Shared/.bundle/legacy/dev/state/deployment.json?overwrite=true
> {
>   "cli_version": "0.232.0",
>   "files": [
>     {
>       "is_notebook": false,
>       "local_path": "src/dbx_pipeline_legacy/empty/empty.py"
>     },
>     "... (38 additional elements)"
>   ],
>   "id": "1b2d9019-5c88-4138-9704-a4419d83395a",
>   "seq": 163,
>   "timestamp": "2024-10-30T17:30:16.089689033Z",
>   "version": 1
> }
< HTTP/2.0 200 OK pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=deploy:state-push sdk=true
12:30:16 DEBUG Apply pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=ApplyWorkspaceRootPermissions
12:30:16 DEBUG GET /api/2.0/workspace/get-status?path=/Shared/.bundle/legacy/dev/resources
< HTTP/2.0 404 Not Found
< {
<   "error_code": "RESOURCE_DOES_NOT_EXIST",
<   "message": "Path (/Shared/.bundle/legacy/dev/resources) doesn't exist."
< } pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=ApplyWorkspaceRootPermissions sdk=true
12:30:16 DEBUG non-retriable error: Path (/Shared/.bundle/legacy/dev/resources) doesn't exist. pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=ApplyWorkspaceRootPermissions sdk=true
12:30:16 ERROR Error: Path (/Shared/.bundle/legacy/dev/resources) doesn't exist. pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=ApplyWorkspaceRootPermissions
12:30:16 ERROR Error: Path (/Shared/.bundle/legacy/dev/resources) doesn't exist. pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq
12:30:16 DEBUG Apply pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=lock:release
12:30:16  INFO Releasing deployment lock pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=lock:release
12:30:16 DEBUG GET /api/2.0/workspace/get-status?path=/Workspace/Shared/.bundle/legacy/dev/state/deploy.lock&return_export_info=true
< HTTP/2.0 200 OK
< {
<   "created_at": 1730309413295,
<   "modified_at": 1730309413295,
<   "object_id": 3057758101523416,
<   "object_type": "FILE",
<   "path": "/Workspace/Shared/.bundle/legacy/dev/state/deploy.lock",
<   "resource_id": "3057758101523416"
< } pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=lock:release sdk=true
12:30:17 DEBUG GET /api/2.0/workspace/get-status?path=/Workspace/Shared/.bundle/legacy/dev/state/deploy.lock&return_export_info=true
< HTTP/2.0 200 OK
< {
<   "created_at": 1730309413295,
<   "modified_at": 1730309413295,
<   "object_id": 3057758101523416,
<   "object_type": "FILE",
<   "path": "/Workspace/Shared/.bundle/legacy/dev/state/deploy.lock",
<   "resource_id": "3057758101523416"
< } pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=lock:release sdk=true
12:30:17 DEBUG GET /api/2.0/workspace/export?direct_download=true&path=/Workspace/Shared/.bundle/legacy/dev/state/deploy.lock
< HTTP/2.0 200 OK
< <Streaming response> pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=lock:release sdk=true
12:30:17 DEBUG POST /api/2.0/workspace/delete
> {
>   "path": "/Workspace/Shared/.bundle/legacy/dev/state/deploy.lock"
> }
< HTTP/2.0 200 OK
< {} pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=lock:release sdk=true
12:30:17 ERROR Error: Path (/Shared/.bundle/legacy/dev/resources) doesn't exist. pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred
12:30:17 ERROR Error: Path (/Shared/.bundle/legacy/dev/resources) doesn't exist. pid=1863989 mutator=seq mutator=deploy mutator=seq mutator=seq
12:30:17 ERROR Error: Path (/Shared/.bundle/legacy/dev/resources) doesn't exist. pid=1863989 mutator=seq mutator=deploy mutator=seq
12:30:17 ERROR Error: Path (/Shared/.bundle/legacy/dev/resources) doesn't exist. pid=1863989 mutator=seq mutator=deploy
12:30:17 ERROR Error: Path (/Shared/.bundle/legacy/dev/resources) doesn't exist. pid=1863989 mutator=seq
Warning: the bundle root path /Workspace/Shared/.bundle/legacy/dev is writable by all workspace users

The bundle is configured to use /Workspace/Shared, which will give read/write access to all users. If this is intentional, add CAN_MANAGE for 'group_name: users' permission to your bundle configuration. If the deployment should be restricted, move it to a restricted folder such as /Workspace/Users/<username or principal name>.

Error: Path (/Shared/.bundle/legacy/dev/resources) doesn't exist.

12:30:17 ERROR failed execution pid=1863989 exit_code=1 error=AlreadyPrinted

[NodeJSmith]

Closing, #1867 beat me to it

[pietern]

Thanks for reporting anyway!

The linked thread has a workaround you can apply.

[andrewnester]

The patch release containing the fix (0.223.1) was just released, please upgrade