No longer works with ShadowRun.exe - directory not found

[jacklul]

For reference ShadowRun.exe from this guide - https://github.com/rclone/rclone/wiki/Using-Volume-Shadow-Copy-Service-%28VSS%29-with-rclone

What is the problem you are having with rclone?

Rclone 1.65.0 throws error "error reading source root directory: directory not found" when trying to synchronize from shadow drive letter using ShadowRun.exe
Rclone 1.64.2 works fine

rclone version for 1.64.2

rclone v1.64.2
- os/version: Microsoft Windows 10 Home 22H2 (64 bit)
- os/kernel: 10.0.19045.3693 (x86_64)
- os/type: windows
- os/arch: amd64
- go/version: go1.21.3
- go/linking: static
- go/tags: cmount

rclone version for 1.65.0

rclone v1.65.0
- os/version: Microsoft Windows 10 Home 22H2 (64 bit)
- os/kernel: 10.0.19045.3693 (x86_64)
- os/type: windows
- os/arch: amd64
- go/version: go1.21.4
- go/linking: static
- go/tags: cmount

A log from the command with the -vv flag (e.g. output from rclone -vv copy /tmp remote:tmp)

Log

2023/11/27 17:27:31 INFO  : Starting bandwidth limiter at 5Mi:10Mi Byte/s
2023/11/27 17:27:31 DEBUG : rclone: Version "v1.65.0" starting with parameters ["C:\\Users\\Jacklul\\Programy\\rclone.exe" "--config=C:\\Users\\Jacklul\\.backup\\rclone.conf" "--filter-from=C:\\Users\\Jacklul\\.backup\\filter.txt" "sync" "U:/" "cloud:" "--skip-links" "--ignore-case" "--fast-list" "--transfers" "8" "--checkers" "16" "--track-renames" "--track-renames-strategy" "leaf" "--no-update-modtime" "--size-only" "--order-by" "size,mixed,75" "--bwlimit" "5M:10M" "--delete-excluded" "-vv" "--log-file=R:/rclone.log" "--progress" "--stats" "1s"]
2023/11/27 17:27:31 DEBUG : Creating backend with remote "U:/"
2023/11/27 17:27:31 DEBUG : Using config file from "C:\\Users\\Jacklul\\.backup\\rclone.conf"
2023/11/27 17:27:31 DEBUG : local: detected overridden config - adding "{HK82T}" suffix to name
2023/11/27 17:27:31 DEBUG : fs cache: renaming cache item "U:/" to be canonical "local{HK82T}://?/U:/"
2023/11/27 17:27:31 DEBUG : Creating backend with remote "cloud:"
2023/11/27 17:27:31 DEBUG : Creating backend with remote "onedrive:Backup"
2023/11/27 17:27:31 ERROR : Local file system at //?/U:/: error reading source root directory: directory not found
2023/11/27 17:27:31 INFO  : Encrypted drive 'cloud:': Making map for --track-renames
2023/11/27 17:27:31 INFO  : Encrypted drive 'cloud:': Finished making map for --track-renames
2023/11/27 17:27:31 DEBUG : Encrypted drive 'cloud:': Waiting for checks to finish
2023/11/27 17:27:31 DEBUG : Encrypted drive 'cloud:': Waiting for renames to finish
2023/11/27 17:27:31 DEBUG : Encrypted drive 'cloud:': Waiting for transfers to finish
2023/11/27 17:27:31 ERROR : Encrypted drive 'cloud:': not deleting files as there were IO errors
2023/11/27 17:27:31 ERROR : Encrypted drive 'cloud:': not deleting directories as there were IO errors
2023/11/27 17:27:31 ERROR : Attempt 1/3 failed with 1 errors and: directory not found
2023/11/27 17:27:31 ERROR : Local file system at //?/U:/: error reading source root directory: directory not found
2023/11/27 17:27:31 INFO  : Encrypted drive 'cloud:': Making map for --track-renames
2023/11/27 17:27:31 INFO  : Encrypted drive 'cloud:': Finished making map for --track-renames
2023/11/27 17:27:31 DEBUG : Encrypted drive 'cloud:': Waiting for checks to finish
2023/11/27 17:27:31 DEBUG : Encrypted drive 'cloud:': Waiting for renames to finish
2023/11/27 17:27:31 DEBUG : Encrypted drive 'cloud:': Waiting for transfers to finish
2023/11/27 17:27:31 ERROR : Encrypted drive 'cloud:': not deleting files as there were IO errors
2023/11/27 17:27:31 ERROR : Encrypted drive 'cloud:': not deleting directories as there were IO errors
2023/11/27 17:27:31 ERROR : Attempt 2/3 failed with 1 errors and: directory not found
2023/11/27 17:27:32 ERROR : Local file system at //?/U:/: error reading source root directory: directory not found
2023/11/27 17:27:32 INFO  : Encrypted drive 'cloud:': Making map for --track-renames
2023/11/27 17:27:32 INFO  : Encrypted drive 'cloud:': Finished making map for --track-renames
2023/11/27 17:27:32 DEBUG : Encrypted drive 'cloud:': Waiting for checks to finish
2023/11/27 17:27:32 DEBUG : Encrypted drive 'cloud:': Waiting for renames to finish
2023/11/27 17:27:32 DEBUG : Encrypted drive 'cloud:': Waiting for transfers to finish
2023/11/27 17:27:32 ERROR : Encrypted drive 'cloud:': not deleting files as there were IO errors
2023/11/27 17:27:32 ERROR : Encrypted drive 'cloud:': not deleting directories as there were IO errors
2023/11/27 17:27:32 ERROR : Attempt 3/3 failed with 1 errors and: directory not found
2023/11/27 17:27:32 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:         0.9s

2023/11/27 17:27:32 DEBUG : 5 go routines active
2023/11/27 17:27:32 Failed to sync: directory not found

---

I'm using this bat script I wrote some time ago: https://github.com/jacklul/rclone-backup/blob/master/Windows/rclone-backup.bat with this configuration:

Configuration "config-cloud.conf"

RCLONE_CONFIG=.\rclone.conf
FILTER_RULES=.\filter.txt

USE_VSS=true
VSS_DRIVE=U

REMOTE_PATH=cloud:
ARGUMENTS=--skip-links --ignore-case --fast-list --transfers 8 --checkers 16 --track-renames --track-renames-strategy leaf --no-update-modtime --size-only --order-by size,mixed,75 --bwlimit 5M:10M --delete-excluded

rclone.conf is just a standard onedrive remote wrapped in cloud (crypt) remote.

Full console output of the script

ARGUMENTS: --config="C:\Users\Jacklul\.backup\rclone.conf" --filter-from="C:\Users\Jacklul\.backup\filter.txt" sync C/ cloud: --skip-links --ignore-case --fast-list --transfers 8 --checkers 16 --track-renames --track-renames-strategy leaf --no-update-modtime --size-only --order-by size,mixed,75 --bwlimit 5M:10M --delete-excluded --progress --stats 1s


ShadowRun.exe v0.5.1 - Volume Shadow Copy Runner.
Copyright (C) 2020 Albertony. All rights reserved.

(Option: Set process environment)
(Option: Mount shadow copies as temporary drives)
(Option: Mount shadow copies as temporary drives 'U')
(Option: Execute binary/script after shadow creation 'C:\Users\Jacklul\Programy\rclone.exe')
(Option: Create shadow copy set)
- Setting the VSS context to: 0x00000010
Creating shadow set {f6816d71-2266-4b49-8ca4-00f1ec1c10d2}
- Adding volume \\?\Volume{b3eb06ce-acdf-4945-8a67-b5a213d7a4d7}\ [C:\] to the shadow set...
Creating the shadow (DoSnapshotSet) ...
(Waiting for the asynchronous operation to finish...)
Shadow set succesfully created.
Mounting shadow copies ...
- Mounted U: to \\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy8
Setting process environment variables ...
Executing command: "C:\Users\Jacklul\Programy\rclone.exe" "--config=C:\Users\Jacklul\.backup\rclone.conf" "--filter-from=C:\Users\Jacklul\.backup\filter.txt" "sync" "U:/" "cloud:" "--skip-links" "--ignore-case" "--fast-list" "--transfers" "8" "--checkers" "16" "--track-renames" "--track-renames-strategy" "leaf" "--no-update-modtime" "--size-only" "--order-by" "size,mixed,75" "--bwlimit" "5M:10M" "--delete-excluded" "--progress" "--stats" "1s"
-----------------------------------------------------
2023/11/27 17:41:47 ERROR : Local file system at //?/U:/: error reading source root directory: directory not found
2023/11/27 17:41:47 ERROR : Encrypted drive 'cloud:': not deleting files as there were IO errors
2023/11/27 17:41:47 ERROR : Encrypted drive 'cloud:': not deleting directories as there were IO errors
2023/11/27 17:41:47 ERROR : Attempt 1/3 failed with 1 errors and: directory not found
2023/11/27 17:41:47 ERROR : Local file system at //?/U:/: error reading source root directory: directory not found
2023/11/27 17:41:47 ERROR : Encrypted drive 'cloud:': not deleting files as there were IO errors
2023/11/27 17:41:47 ERROR : Encrypted drive 'cloud:': not deleting directories as there were IO errors
2023/11/27 17:41:47 ERROR : Attempt 2/3 failed with 1 errors and: directory not found
2023/11/27 17:41:47 ERROR : Local file system at //?/U:/: error reading source root directory: directory not found
2023/11/27 17:41:47 ERROR : Encrypted drive 'cloud:': not deleting files as there were IO errors
2023/11/27 17:41:47 ERROR : Encrypted drive 'cloud:': not deleting directories as there were IO errors
2023/11/27 17:41:47 ERROR : Attempt 3/3 failed with 1 errors and: directory not found
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:         1.4s
2023/11/27 17:41:47 Failed to sync: directory not found
-----------------------------------------------------
Command returned with exit code: 3
Unounting shadow copies ...
- Unmounted U: from \\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy8

Program completed, returning exit code 3.
Backup operation failed, restart synchronization [Y,N]?

[jcasale]

I also have this issue, it seems that something changed in v1.65.0 such that you can no longer source the root of a drive on Windows.

It works from any directory, just not the root.

[artemiuss]

I've run into this, too. A temporary solution might be to access the disk as a network share i.e., to use use \\HOST\d\ instead of D:\, as a source.

[nahid6970]

same issue cant use rclone ncdu c:\ or rclone ncdu d:\

[jcasale]

I believe this is now being addressed in #7468.