Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sync cannot overwrite files if they are archived already #1688

Open
SzabKel opened this issue Feb 28, 2022 · 11 comments
Open

Sync cannot overwrite files if they are archived already #1688

SzabKel opened this issue Feb 28, 2022 · 11 comments

Comments

@SzabKel
Copy link

SzabKel commented Feb 28, 2022

I am using azcopy to backup a file share to blob storage. The files rarely change and are archived immediately after being uploaded by a lifecycle rule.

Which version of the AzCopy was used? AzCopy 10.13.0

Which platform are you using? (ex: Windows, Mac, Linux)

Windows

What command did you run?

sync "D:..\Share" "https://......blob.core.windows.net/...." --recursive=true --delete-destination=true

What problem was encountered?

409 This operation is not permitted on an archived blob.. When Uploading blob.

How can we reproduce the problem in the simplest way?

  1. Upload a file to the storage container using the sync command
  2. Archive tier the file
  3. Change the file at the source
  4. Run sync again

Previous issue: #993

Have you found a mitigation/solution?

Yes. There should be a flag (something like "--allow-delete-before") to allow deletion of the file before uploading the new version. A delete and a new upload should work according to the docs.
Similarly to this: rclone/rclone#4819

@siminsavani-msft
Copy link
Member

Hi @SzabKel ! I am unable to reproduce your issue. Could you please run your command with --log-level=DEBUG and share with us the logs?

@SzabKel
Copy link
Author

SzabKel commented Mar 9, 2022

Hello @siminsavani-msft !

I used the newest version (10.14.0) for this, my command: azcopy sync "D:\Megosztas" "https://.....blob.core.windows.net/....-backup?sp=racwdli&st=202.....&sig=%2....D" --recursive=true --delete-destination=true --log-level=DEBUG

Logs for one file that failed:

2022/03/09 06:55:11 JobID=6bbe947d-6ed9-974e-4630-1ef09d0ace6a, Part#=0, TransfersDone=4 of 5
2022/03/09 06:55:11 ==> OUTGOING REQUEST (Try=1)
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=MmE2YWIzNzMtNDcyZC1kNzQyLTU3OTYtZjBjMGQ4ZjMwNzU0&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [e60dff68-8258-4a0f-7f06-5e1ec161712f]
   X-Ms-Version: [2020-04-08]

2022/03/09 06:55:11 ==> OUTGOING REQUEST (Try=1)
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=MGQ4ZDkzMDAtMGEzYi0yYTQ1LTViYmMtOTU4NDI0NTdiZDU5&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [98736f4f-ec22-41da-44b9-44bdc401877d]
   X-Ms-Version: [2020-04-08]

2022/03/09 06:55:11 ==> OUTGOING REQUEST (Try=1)
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=YTVkNjlkMjUtMjU5ZS04MDQ2LTQyMmYtZjFhYzMzZDA0ZTNl&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [0d27f5e0-213c-459b-560f-0d1ebacd1cbf]
   X-Ms-Version: [2020-04-08]

2022/03/09 06:55:11 ==> OUTGOING REQUEST (Try=1)
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=Y2FkNjI1OGEtNDg5YS0wMTQ0LTQ0NTUtZThhNWZlMWNkZWQy&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [cfad45a2-2fea-40a1-5f66-ef255dcb351d]
   X-Ms-Version: [2020-04-08]

2022/03/09 06:55:11 ==> OUTGOING REQUEST (Try=1)
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=MTcxZTVhZWMtMWZiMS0wZDRiLTVlZmMtMGQyNGM3NWYxMjNm&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [741a0384-1d9e-4788-7477-025e6c25ab5e]
   X-Ms-Version: [2020-04-08]

2022/03/09 06:55:11 ==> OUTGOING REQUEST (Try=1)
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=YTdmMzQ5NDUtYmYzOS1iZjQyLTU1OWItOGU4NzY3ZTA2NDJl&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [8fba6ea5-2569-460e-4a12-c5ea05c698df]
   X-Ms-Version: [2020-04-08]

2022/03/09 06:55:11 ==> OUTGOING REQUEST (Try=1)
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=YzQzZTc2MTktNzYwNC1kYzQ0LTVkMzYtMzIyOTNlNzk2ZDA0&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [2ea97ab2-ad60-430b-72ca-03332f6c2b13]
   X-Ms-Version: [2020-04-08]

2022/03/09 06:55:11 ==> OUTGOING REQUEST (Try=1)
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=NGQ2NTJhYjktMTUwYi1kNzQ5LTc2NTUtYzEwZmEzNWU2ZjUw&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [6a717684-c388-4bdd-7780-e00bff93b9eb]
   X-Ms-Version: [2020-04-08]

2022/03/09 06:55:11 ==> OUTGOING REQUEST (Try=1)
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=YTRmYzU5ODMtMDYwZC1mMTRkLTQxMzctOWMyYWU2ZGNkMGUx&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [bac119d9-509e-4853-7f07-dacd638866d4]
   X-Ms-Version: [2020-04-08]

2022/03/09 06:55:11 ==> OUTGOING REQUEST (Try=1)
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=ZTlhNjVkMzUtZmRhNS1iMDQ0LTYyZjQtNjU3Yzc0MGRiMGFl&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [99fd6733-f66d-4377-6aed-9efbfa9c68dc]
   X-Ms-Version: [2020-04-08]

2022/03/09 06:55:11 ==> OUTGOING REQUEST (Try=1)
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=YjU1MjliODgtM2I4ZC04NzRkLTdlNTEtMGYxMWJkZDVkMzFj&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [1e0635d0-491c-4022-6391-64b445ce1982]
   X-Ms-Version: [2020-04-08]

2022/03/09 06:55:11 ==> OUTGOING REQUEST (Try=1)
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=YzY5NTMxZmEtYzIxYS1jODRjLTVjNTYtMjhhMDBmNzJjYjI4&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [96be84c4-c502-4be2-41ee-6a0e99320bae]
   X-Ms-Version: [2020-04-08]

2022/03/09 06:55:11 ==> OUTGOING REQUEST (Try=1)
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=ODE5YzlhZjMtZmQ2ZS04MzQxLTZmZmEtN2EyMGJiNWE2NzBi&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [e095b11e-2019-42bb-4aef-4d56eb19004a]
   X-Ms-Version: [2020-04-08]

2022/03/09 06:55:11 ==> OUTGOING REQUEST (Try=1)
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=ZGY2ZTY3ZWItM2FjOC1hMjQ5LTViNmItZDdmZDhiMzQ5NjZl&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [3bb5960c-b0c4-48ae-5c01-8c43941f1fed]
   X-Ms-Version: [2020-04-08]

2022/03/09 06:55:11 ==> REQUEST/RESPONSE (Try=1/82.8096ms, OpTime=559.0321ms) -- RESPONSE SUCCESSFULLY RECEIVED
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=ODI4MWZjMWMtZDY1MC00MTQ4LTU5MWQtYWUxNWFjZTU5MzFk&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [6b26d224-47c5-47e9-7818-f313ff7a4093]
   X-Ms-Version: [2020-04-08]
   --------------------------------------------------------------------------------
   RESPONSE Status: 409 This operation is not permitted on an archived blob.
   Content-Length: [233]
   Content-Type: [application/xml]
   Date: [Wed, 09 Mar 2022 06:55:10 GMT]
   Server: [Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0]
   X-Ms-Client-Request-Id: [6b26d224-47c5-47e9-7818-f313ff7a4093]
   X-Ms-Error-Code: [BlobArchived]
   X-Ms-Request-Id: [2d569c24-201e-000b-4f82-3304fc000000]
   X-Ms-Version: [2020-04-08]

2022/03/09 06:55:11 ==> OUTGOING REQUEST (Try=1)
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=NGMxYTQ1ZTQtNTkyNi03NjQ4LTc4ZGUtYmY0YmFjNTY0ZTI3&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [5a6a7166-6a23-42bc-7ad3-b1dfcdd28e65]
   X-Ms-Version: [2020-04-08]

2022/03/09 06:55:11 ==> OUTGOING REQUEST (Try=1)
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=MjE5OWYwZmEtNGJiMS0zMDQ0LTYzOTItNGI2YjI5ZDY4NmU0&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [f164fb41-ec36-46ee-5533-706b551b2366]
   X-Ms-Version: [2020-04-08]

2022/03/09 06:55:11 ERR: [P#0-T#0] UPLOADFAILED: \\?\D:\Megosztas\VeeamRecoveryMedia_25584_SERVER.iso : 409 : 409 This operation is not permitted on an archived blob.. When Staging block. X-Ms-Request-Id: 2d569c24-201e-000b-4f82-3304fc000000

   Dst: https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04
2022/03/09 06:55:11 ==> REQUEST/RESPONSE (Try=1/15.1322ms, OpTime=15.1322ms) -- REQUEST ERROR
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=NGMxYTQ1ZTQtNTkyNi03NjQ4LTc4ZGUtYmY0YmFjNTY0ZTI3&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [5a6a7166-6a23-42bc-7ad3-b1dfcdd28e65]
   X-Ms-Version: [2020-04-08]
   --------------------------------------------------------------------------------
   ERROR:
-> github.com/Azure/azure-pipeline-go/pipeline.NewError, /home/vsts/go/pkg/mod/github.com/!azure/azure-pipeline-go@v0.2.3/pipeline/error.go:157
HTTP request failed

Put "https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=NGMxYTQ1ZTQtNTkyNi03NjQ4LTc4ZGUtYmY0YmFjNTY0ZTI3&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901": context canceled


2022/03/09 06:55:11 ==> REQUEST/RESPONSE (Try=1/9.9487ms, OpTime=9.9487ms) -- REQUEST ERROR
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=MjE5OWYwZmEtNGJiMS0zMDQ0LTYzOTItNGI2YjI5ZDY4NmU0&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [f164fb41-ec36-46ee-5533-706b551b2366]
   X-Ms-Version: [2020-04-08]
   --------------------------------------------------------------------------------
   ERROR:
-> github.com/Azure/azure-pipeline-go/pipeline.NewError, /home/vsts/go/pkg/mod/github.com/!azure/azure-pipeline-go@v0.2.3/pipeline/error.go:157
HTTP request failed

Put "https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=MjE5OWYwZmEtNGJiMS0zMDQ0LTYzOTItNGI2YjI5ZDY4NmU0&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901": context canceled


2022/03/09 06:55:11 ==> REQUEST/RESPONSE (Try=1/129.3014ms, OpTime=129.3014ms) -- REQUEST ERROR
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=ZGY2ZTY3ZWItM2FjOC1hMjQ5LTViNmItZDdmZDhiMzQ5NjZl&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [3bb5960c-b0c4-48ae-5c01-8c43941f1fed]
   X-Ms-Version: [2020-04-08]
   --------------------------------------------------------------------------------
   ERROR:
-> github.com/Azure/azure-pipeline-go/pipeline.NewError, /home/vsts/go/pkg/mod/github.com/!azure/azure-pipeline-go@v0.2.3/pipeline/error.go:157
HTTP request failed

Put "https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=ZGY2ZTY3ZWItM2FjOC1hMjQ5LTViNmItZDdmZDhiMzQ5NjZl&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901": context canceled


2022/03/09 06:55:11 ==> REQUEST/RESPONSE (Try=1/0s, OpTime=427.8497ms) -- REQUEST ERROR
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=MGQ4ZDkzMDAtMGEzYi0yYTQ1LTViYmMtOTU4NDI0NTdiZDU5&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [98736f4f-ec22-41da-44b9-44bdc401877d]
   X-Ms-Version: [2020-04-08]
   --------------------------------------------------------------------------------
   ERROR:
-> github.com/Azure/azure-pipeline-go/pipeline.NewError, /home/vsts/go/pkg/mod/github.com/!azure/azure-pipeline-go@v0.2.3/pipeline/error.go:157
HTTP request failed

Put "https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=MGQ4ZDkzMDAtMGEzYi0yYTQ1LTViYmMtOTU4NDI0NTdiZDU5&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901": context canceled


2022/03/09 06:55:11 ==> REQUEST/RESPONSE (Try=1/7.3825ms, OpTime=285.9558ms) -- REQUEST ERROR
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=YTRmYzU5ODMtMDYwZC1mMTRkLTQxMzctOWMyYWU2ZGNkMGUx&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [bac119d9-509e-4853-7f07-dacd638866d4]
   X-Ms-Version: [2020-04-08]
   --------------------------------------------------------------------------------
   ERROR:
-> github.com/Azure/azure-pipeline-go/pipeline.NewError, /home/vsts/go/pkg/mod/github.com/!azure/azure-pipeline-go@v0.2.3/pipeline/error.go:157
HTTP request failed

Put "https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=YTRmYzU5ODMtMDYwZC1mMTRkLTQxMzctOWMyYWU2ZGNkMGUx&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901": context canceled


2022/03/09 06:55:11 ==> REQUEST/RESPONSE (Try=1/4.8768ms, OpTime=133.3416ms) -- REQUEST ERROR
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=YzY5NTMxZmEtYzIxYS1jODRjLTVjNTYtMjhhMDBmNzJjYjI4&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [96be84c4-c502-4be2-41ee-6a0e99320bae]
   X-Ms-Version: [2020-04-08]
   --------------------------------------------------------------------------------
   ERROR:
-> github.com/Azure/azure-pipeline-go/pipeline.NewError, /home/vsts/go/pkg/mod/github.com/!azure/azure-pipeline-go@v0.2.3/pipeline/error.go:157
HTTP request failed

Put "https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=YzY5NTMxZmEtYzIxYS1jODRjLTVjNTYtMjhhMDBmNzJjYjI4&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901": context canceled


2022/03/09 06:55:11 ==> REQUEST/RESPONSE (Try=1/0s, OpTime=529.8678ms) -- REQUEST ERROR
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=NTI5ZDU1ZWYtZDg3MS04MjQ0LTQzNDAtMTFiNDQ4MmU1MjIz&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [65815951-6aad-44a2-6106-bd780e12d84b]
   X-Ms-Version: [2020-04-08]
   --------------------------------------------------------------------------------
   ERROR:
-> github.com/Azure/azure-pipeline-go/pipeline.NewError, /home/vsts/go/pkg/mod/github.com/!azure/azure-pipeline-go@v0.2.3/pipeline/error.go:157
HTTP request failed

Put "https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=NTI5ZDU1ZWYtZDg3MS04MjQ0LTQzNDAtMTFiNDQ4MmU1MjIz&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901": context canceled


2022/03/09 06:55:11 ==> REQUEST/RESPONSE (Try=1/1.1843ms, OpTime=138.7983ms) -- REQUEST ERROR
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=ZTlhNjVkMzUtZmRhNS1iMDQ0LTYyZjQtNjU3Yzc0MGRiMGFl&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [99fd6733-f66d-4377-6aed-9efbfa9c68dc]
   X-Ms-Version: [2020-04-08]
   --------------------------------------------------------------------------------
   ERROR:
-> github.com/Azure/azure-pipeline-go/pipeline.NewError, /home/vsts/go/pkg/mod/github.com/!azure/azure-pipeline-go@v0.2.3/pipeline/error.go:157
HTTP request failed

Put "https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=ZTlhNjVkMzUtZmRhNS1iMDQ0LTYyZjQtNjU3Yzc0MGRiMGFl&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901": context canceled


2022/03/09 06:55:11 ==> REQUEST/RESPONSE (Try=1/686.2µs, OpTime=428.4787ms) -- REQUEST ERROR
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=YTVkNjlkMjUtMjU5ZS04MDQ2LTQyMmYtZjFhYzMzZDA0ZTNl&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [0d27f5e0-213c-459b-560f-0d1ebacd1cbf]
   X-Ms-Version: [2020-04-08]
   --------------------------------------------------------------------------------
   ERROR:
-> github.com/Azure/azure-pipeline-go/pipeline.NewError, /home/vsts/go/pkg/mod/github.com/!azure/azure-pipeline-go@v0.2.3/pipeline/error.go:157
HTTP request failed

Put "https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=YTVkNjlkMjUtMjU5ZS04MDQ2LTQyMmYtZjFhYzMzZDA0ZTNl&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901": context canceled


2022/03/09 06:55:11 ==> REQUEST/RESPONSE (Try=1/0s, OpTime=134.0299ms) -- REQUEST ERROR
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=ODE5YzlhZjMtZmQ2ZS04MzQxLTZmZmEtN2EyMGJiNWE2NzBi&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [e095b11e-2019-42bb-4aef-4d56eb19004a]
   X-Ms-Version: [2020-04-08]
   --------------------------------------------------------------------------------
   ERROR:
-> github.com/Azure/azure-pipeline-go/pipeline.NewError, /home/vsts/go/pkg/mod/github.com/!azure/azure-pipeline-go@v0.2.3/pipeline/error.go:157
HTTP request failed

Put "https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=ODE5YzlhZjMtZmQ2ZS04MzQxLTZmZmEtN2EyMGJiNWE2NzBi&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901": context canceled


2022/03/09 06:55:11 ==> REQUEST/RESPONSE (Try=1/1.6882ms, OpTime=521.9112ms) -- REQUEST ERROR
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=MmE2YWIzNzMtNDcyZC1kNzQyLTU3OTYtZjBjMGQ4ZjMwNzU0&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [e60dff68-8258-4a0f-7f06-5e1ec161712f]
   X-Ms-Version: [2020-04-08]
   --------------------------------------------------------------------------------
   ERROR:
-> github.com/Azure/azure-pipeline-go/pipeline.NewError, /home/vsts/go/pkg/mod/github.com/!azure/azure-pipeline-go@v0.2.3/pipeline/error.go:157
HTTP request failed

Put "https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=MmE2YWIzNzMtNDcyZC1kNzQyLTU3OTYtZjBjMGQ4ZjMwNzU0&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901": context canceled


2022/03/09 06:55:11 ==> REQUEST/RESPONSE (Try=1/503.9µs, OpTime=600.0827ms) -- REQUEST ERROR
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=Y2QwMWEyYjMtOWU0Ni1hMzQzLTY5MjQtMWEyMzQzZGNhODZj&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [580da6bf-4076-426d-7b10-b0162bb3ab3b]
   X-Ms-Version: [2020-04-08]
   --------------------------------------------------------------------------------
   ERROR:
-> github.com/Azure/azure-pipeline-go/pipeline.NewError, /home/vsts/go/pkg/mod/github.com/!azure/azure-pipeline-go@v0.2.3/pipeline/error.go:157
HTTP request failed

Put "https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=Y2QwMWEyYjMtOWU0Ni1hMzQzLTY5MjQtMWEyMzQzZGNhODZj&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901": context canceled


2022/03/09 06:55:11 ==> REQUEST/RESPONSE (Try=1/1.6882ms, OpTime=320.5586ms) -- REQUEST ERROR
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=YTdmMzQ5NDUtYmYzOS1iZjQyLTU1OWItOGU4NzY3ZTA2NDJl&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [8fba6ea5-2569-460e-4a12-c5ea05c698df]
   X-Ms-Version: [2020-04-08]
   --------------------------------------------------------------------------------
   ERROR:
-> github.com/Azure/azure-pipeline-go/pipeline.NewError, /home/vsts/go/pkg/mod/github.com/!azure/azure-pipeline-go@v0.2.3/pipeline/error.go:157
HTTP request failed

Put "https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=YTdmMzQ5NDUtYmYzOS1iZjQyLTU1OWItOGU4NzY3ZTA2NDJl&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901": context canceled


2022/03/09 06:55:11 ==> REQUEST/RESPONSE (Try=1/0s, OpTime=287.644ms) -- REQUEST ERROR
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=NGQ2NTJhYjktMTUwYi1kNzQ5LTc2NTUtYzEwZmEzNWU2ZjUw&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [6a717684-c388-4bdd-7780-e00bff93b9eb]
   X-Ms-Version: [2020-04-08]
   --------------------------------------------------------------------------------
   ERROR:
-> github.com/Azure/azure-pipeline-go/pipeline.NewError, /home/vsts/go/pkg/mod/github.com/!azure/azure-pipeline-go@v0.2.3/pipeline/error.go:157
HTTP request failed

Put "https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=NGQ2NTJhYjktMTUwYi1kNzQ5LTc2NTUtYzEwZmEzNWU2ZjUw&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901": context canceled


2022/03/09 06:55:11 ==> REQUEST/RESPONSE (Try=1/0s, OpTime=425.9768ms) -- REQUEST ERROR
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=Y2FkNjI1OGEtNDg5YS0wMTQ0LTQ0NTUtZThhNWZlMWNkZWQy&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [cfad45a2-2fea-40a1-5f66-ef255dcb351d]
   X-Ms-Version: [2020-04-08]
   --------------------------------------------------------------------------------
   ERROR:
-> github.com/Azure/azure-pipeline-go/pipeline.NewError, /home/vsts/go/pkg/mod/github.com/!azure/azure-pipeline-go@v0.2.3/pipeline/error.go:157
HTTP request failed

Put "https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=Y2FkNjI1OGEtNDg5YS0wMTQ0LTQ0NTUtZThhNWZlMWNkZWQy&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901": context canceled


2022/03/09 06:55:11 ==> REQUEST/RESPONSE (Try=1/2.6919ms, OpTime=326.0104ms) -- REQUEST ERROR
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=MTcxZTVhZWMtMWZiMS0wZDRiLTVlZmMtMGQyNGM3NWYxMjNm&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [741a0384-1d9e-4788-7477-025e6c25ab5e]
   X-Ms-Version: [2020-04-08]
   --------------------------------------------------------------------------------
   ERROR:
-> github.com/Azure/azure-pipeline-go/pipeline.NewError, /home/vsts/go/pkg/mod/github.com/!azure/azure-pipeline-go@v0.2.3/pipeline/error.go:157
HTTP request failed

Put "https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=MTcxZTVhZWMtMWZiMS0wZDRiLTVlZmMtMGQyNGM3NWYxMjNm&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901": context canceled


2022/03/09 06:55:11 ==> REQUEST/RESPONSE (Try=1/0s, OpTime=289.6506ms) -- REQUEST ERROR
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=YzQzZTc2MTktNzYwNC1kYzQ0LTVkMzYtMzIyOTNlNzk2ZDA0&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [2ea97ab2-ad60-430b-72ca-03332f6c2b13]
   X-Ms-Version: [2020-04-08]
   --------------------------------------------------------------------------------
   ERROR:
-> github.com/Azure/azure-pipeline-go/pipeline.NewError, /home/vsts/go/pkg/mod/github.com/!azure/azure-pipeline-go@v0.2.3/pipeline/error.go:157
HTTP request failed

Put "https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=YzQzZTc2MTktNzYwNC1kYzQ0LTVkMzYtMzIyOTNlNzk2ZDA0&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901": context canceled


2022/03/09 06:55:11 ==> REQUEST/RESPONSE (Try=1/143.3043ms, OpTime=570.1338ms) -- REQUEST ERROR
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=ZGM4ZDJiZGEtOTVhNS00YTQ4LTY2ODEtNzcxNjJlNDhhNWQ4&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [f694d2d3-fc46-4f7c-58f5-79b2cef9d7d7]
   X-Ms-Version: [2020-04-08]
   --------------------------------------------------------------------------------
   ERROR:
-> github.com/Azure/azure-pipeline-go/pipeline.NewError, /home/vsts/go/pkg/mod/github.com/!azure/azure-pipeline-go@v0.2.3/pipeline/error.go:157
HTTP request failed

Put "https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=ZGM4ZDJiZGEtOTVhNS00YTQ4LTY2ODEtNzcxNjJlNDhhNWQ4&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901": context canceled


2022/03/09 06:55:11 ==> REQUEST/RESPONSE (Try=1/0s, OpTime=555.2784ms) -- REQUEST ERROR
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=YTlkNWI3MDQtM2ExYi0wZjQzLTU2MjAtMTdkMzFkYjFlMmRk&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [ebb9dd85-f042-478d-6fcb-65eb237b4fa6]
   X-Ms-Version: [2020-04-08]
   --------------------------------------------------------------------------------
   ERROR:
-> github.com/Azure/azure-pipeline-go/pipeline.NewError, /home/vsts/go/pkg/mod/github.com/!azure/azure-pipeline-go@v0.2.3/pipeline/error.go:157
HTTP request failed

Put "https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=YTlkNWI3MDQtM2ExYi0wZjQzLTU2MjAtMTdkMzFkYjFlMmRk&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901": context canceled


2022/03/09 06:55:11 ==> REQUEST/RESPONSE (Try=1/1.0037ms, OpTime=136.0335ms) -- REQUEST ERROR
   PUT https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=YjU1MjliODgtM2I4ZC04NzRkLTdlNTEtMGYxMWJkZDVkMzFj&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.14.0 Azure-Storage/0.14 (go1.16.14; Windows_NT)]
   X-Ms-Client-Request-Id: [1e0635d0-491c-4022-6391-64b445ce1982]
   X-Ms-Version: [2020-04-08]
   --------------------------------------------------------------------------------
   ERROR:
-> github.com/Azure/azure-pipeline-go/pipeline.NewError, /home/vsts/go/pkg/mod/github.com/!azure/azure-pipeline-go@v0.2.3/pipeline/error.go:157
HTTP request failed

Put "https://...blob.core.windows.net/..-backup/VeeamRecoveryMedia_25584_SERVER.iso?blockid=YjU1MjliODgtM2I4ZC04NzRkLTdlNTEtMGYxMWJkZDVkMzFj&comp=block&se=2030-01-12T23%3A24%3A33Z&sig=-REDACTED-&sp=racwdli&spr=https&sr=c&st=2022-01-12T15%3A24%3A33Z&sv=2020-08-04&timeout=901": context canceled


2022/03/09 06:55:11 DBG: [P#0-T#0] Finalizing Transfer Cancellation/Failure
2022/03/09 06:55:11 JobID=6bbe947d-6ed9-974e-4630-1ef09d0ace6a, Part#=0, TransfersDone=5 of 5
2022/03/09 06:55:11 all parts of entire Job 6bbe947d-6ed9-974e-4630-1ef09d0ace6a successfully completed, cancelled or paused
2022/03/09 06:55:11 is part of Job which 1 total number of parts done 
2022/03/09 06:55:12 Final job part has been created
2022/03/09 06:55:12 PERF: primary performance constraint is Unknown. States: X:  0, O:  0, M:  0, L:  0, R:  0, D:  0, W:  0, F:  0, B:  0, E:  0, T:  0, GRs: 32
2022/03/09 06:55:12 

Diagnostic stats:
IOPS: 10
End-to-end ms per request: 294
Network Errors: 0.00%
Server Busy: 0.00%

Job 6bbe947d-6ed9-974e-4630-1ef09d0ace6a Summary
Files Scanned at Source: 481745
Files Scanned at Destination: 481745
Elapsed Time (Minutes): 3.7524
Number of Copy Transfers for Files: 5
Number of Copy Transfers for Folder Properties: 0 
Total Number Of Copy Transfers: 5
Number of Copy Transfers Completed: 0
Number of Copy Transfers Failed: 5
Number of Deletions at Destination: 0
Total Number of Bytes Transferred: 0
Total Number of Bytes Enumerated: 664145738
Final Job Status: Failed

@siminsavani-msft
Copy link
Member

siminsavani-msft commented Mar 9, 2022

Hi @SzabKel ! I was able to repro your issues successfully! Thank you for sharing the logs. Unfortunately, archived blobs cannot be read or modified unless it is rehydrated (https://docs.microsoft.com/en-us/azure/storage/blobs/archive-blob?tabs=azure-portal) which is why your file is failing to overwrite.

I would recommend rehydrating the blobs in question, if possible! Let me know if you have any questions!

@SzabKel
Copy link
Author

SzabKel commented Mar 10, 2022

@siminsavani-msft Thank you for trying this out. You mention the same thing I referred to when posting the issue. I knew azure storage does not allow overwrite for existing archived blobs. That is why I asked for an option to allow deleting the file before upload in such a case (maybe it could even work by waiting for this server response and do it then?). Because you can delete an archive tier file (for an extra fee though) and upload the new version again.
The rclone issue I posted has conversation about the same thing. Do you think this is not possible in azcopy's case? Rclone can work with azure storage and do this.
Thank you!

@siminsavani-msft
Copy link
Member

@SzabKel This is a really good suggestion! I will bring this up to the team and inform them of this. Thank you!

@SzabKel
Copy link
Author

SzabKel commented Dec 14, 2022

@siminsavani-msft Any update on this?

@siminsavani-msft
Copy link
Member

Hi @SzabKel ! Not at the moment, sorry :( I will update this thread when we pick it up. Thanks for your patience!

@manurosado
Copy link

following

@SzabKel
Copy link
Author

SzabKel commented May 2, 2023

@siminsavani-msft I tried it out with the newest version (v10.18.1) and the issue still persist. Can't force a file delete or rehydrate when syncing. I manually have to delete the files looking at the logs.

@siminsavani-msft
Copy link
Member

Hi there! Sorry for the inconvenience! We have not been able to pick this up yet. I will make sure to update this thread accordingly when we are able to pick it up.

@fleetwoodstack
Copy link

Is there atleast a way to ignore archived files when copying?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants