Compacting a backup ends with "Error while running [backup_name] : Invalid data format." #2303
Comments
|
The error indicates that the reading of the 7z file fails. |
|
Hi Kenneth, |
|
That sounds really bad, because that means that the 7z module creates broken files! |
|
sure - 7z-signature (37 7A BC AF 27 1C) and -version stamp (00 03) are correct. |
|
That does look like a broken 7z file ... Did you see any errors about hash mismatches or file lengths not being correct? Not sure how many files you have, but can you run something like: This will download all files and check their hashes. The |
|
there's no duplicati-cli script or executeable in my duplicati-installation. |
|
Sorry, my bad, it should be You need to add a username and password too. If you are normally using the WebUI, you can use the "export" feature to get the commandline equivalent. |
Cool feature! I'm starting a repair-operation (via GUI). Will come back when we have a result (Backup:88,60 GB / 30 Versions). Btw.: Do you see any relation between possibly truncated files and ++umgfoin. |
|
I updated your post, not sure if the user/pass was a dummy or real data. If it was real data, you should change the password ASAP. If you have the defect file (and it does not contain sensitive data) I would like a copy. If it does contain sensitive data, maybe we can extract the headers only and have a look at them. |
|
The quota space is not currently used. It is intended to start dropping old backups when the storage space is low, but that feature has not yet been added. |
Thanks for being alert - credentials and FQDN are fake-data.
Indeed, I need to verify this. Would you have a sql-query at hand to select all file-names from the backup referencing blocks in this specific 7z-archive? |
|
To get the files referencing a specific The |
|
Kenneth, |
|
Yes, please send the broken file and I will forward it privately to the managed-lzma author. If you have 3 files, then it means that this error is not a single problem. This means that you can likely not restore files from your backup. |
|
Kenneth, I checked the broken archive - btw. it is partially recoverable. |
|
I sent you a mail |
|
@kenkendk |
I have:
Version info
Duplicati Version:
2.0.1.44_canary_2017-01-24
Operating System:
Linux 2.6.32-042stab120.16 #1 SMP Tue Dec 13 20:58:28 MSK 2016 x86_64 x86_64 x86_64 GNU/Linux
#mono --version
Mono JIT compiler version 3.12.1 (tarball Fr 10. Apr 00:46:47 CEST 2015)
Copyright (C) 2002-2014 Novell, Inc, Xamarin Inc and Contributors. www.mono-project.com
TLS: __thread
SIGSEGV: altstack
Notifications: epoll
Architecture: amd64
Disabled: none
Misc: softdebug
LLVM: supported, not enabled.
GC: sgen
Backend:
sftp
Bug description
Backup finishes with error "Invalid data format." in compact phase.
Steps to reproduce
Actual result:
The error occurs during phase compacting.
Screenshots
debug log
Feb 2, 2017 12:13 PM: Running Backup took 00:57:27.513Feb 2, 2017 12:13 PM: Fatal error
{"ClassName":"System.IO.InvalidDataException","Message":"Invalid data format.","InnerException":null,"HelpURL":null,"StackTraceString":" at master._7zip.Legacy.Lzma2DecoderStream.Read (System.Byte[] buffer, Int32 offset, Int32 count) [0x00000] in :0 \n at ManagedLzma._7zip.Decoder.FileBufferedDecoderStream.Fetch () [0x00000] in :0 \n at ManagedLzma._7zip.Decoder.FileBufferedDecoderStream.Read (System.Byte[] buffer, Int32 offset, Int32 count) [0x00000] in :0 \n at master._7zip.Utilities.UnpackSubStream.Read (System.Byte[] buffer, Int32 offset, Int32 count) [0x00000] in :0 \n at Duplicati.Library.Utility.Utility.ForceStreamRead (System.IO.Stream stream, System.Byte[] buf, Int32 count) [0x00000] in :0 \n at Duplicati.Library.Main.Volumes.BlockVolumeReader.ReadBlock (System.String hash, System.Byte[] blockbuffer) [0x00000] in :0 \n at Duplicati.Library.Main.Operation.CompactHandler.DoCompact (Duplicati.Library.Main.Database.LocalDeleteDatabase db, Boolean hasVerifiedBackend, IDbTransaction& transaction) [0x00000] in :0 \n at Duplicati.Library.Main.Operation.DeleteHandler.DoRun (Duplicati.Library.Main.Database.LocalDeleteDatabase db, IDbTransaction& transaction, Boolean hasVerifiedBacked, Boolean forceCompact) [0x00000] in :0 \n at Duplicati.Library.Main.Operation.BackupHandler.CompactIfRequired (Duplicati.Library.Main.BackendManager backend, Int64 lastVolumeSize) [0x00000] in :0 \n at Duplicati.Library.Main.Operation.BackupHandler.Run (System.String[] sources, IFilter filter) [0x00000] in :0 ","RemoteStackTraceString":null,"RemoteStackIndex":0,"HResult":-2146233085,"Source":"managed-lzma","ExceptionMethod":null,"Data":null}
Feb 2, 2017 12:13 PM: Operation Get with file duplicati-b908bf5f6845a4300a3b2002de1b1457e.dblock.7z.gpg attempt 1 of 5 failed with message: Thread was being aborted
{"ClassName":"System.Threading.ThreadAbortException","Message":"Thread was being aborted","InnerException":null,"HelpURL":null,"StackTraceString":" at (wrapper managed-to-native) System.Threading.WaitHandle:WaitAny_internal (System.Threading.WaitHandle[],int,bool)\n at System.Threading.WaitHandle.WaitAny (System.Threading.WaitHandle[] waitHandles, TimeSpan timeout, Boolean exitContext) [0x00000] in :0 \n at System.Threading.WaitHandle.WaitAny (System.Threading.WaitHandle[] waitHandles, TimeSpan timeout) [0x00000] in :0 \n at Renci.SshNet.SubsystemSession.WaitOnHandle (System.Threading.WaitHandle waitHandle, TimeSpan operationTimeout) [0x00000] in :0 \n at Renci.SshNet.Sftp.SftpSession.RequestRead (System.Byte[] handle, UInt64 offset, UInt32 length) [0x00000] in :0 \n at Renci.SshNet.SftpClient.InternalDownloadFile (System.String path, System.IO.Stream output, Renci.SshNet.Sftp.SftpDownloadAsyncResult asyncResult, System.Action
1 downloadCallback) [0x00000] in <filename unknown>:0 \n at Renci.SshNet.SftpClient.DownloadFile (System.String path, System.IO.Stream output, System.Action1 downloadCallback) [0x00000] in :0 \n at Duplicati.Library.Backend.SSHv2.Get (System.String remotename, System.IO.Stream stream) [0x00000] in :0 \n at Duplicati.Library.Main.BackendManager.coreDoGetPiping (Duplicati.Library.Main.FileEntryItem item, IEncryption useDecrypter, System.Int64& retDownloadSize, System.String& retHashcode) [0x00000] in :0 ","RemoteStackTraceString":null,"RemoteStackIndex":0,"HResult":-2146233040,"Source":"mscorlib","ExceptionMethod":null,"Data":null}Feb 2, 2017 12:13 PM: RemoteOperationGet took 00:00:23.942
Feb 2, 2017 12:12 PM: Backend event: Get - Started: duplicati-b908bf5f6845a4300a3b2002de1b1457e.dblock.7z.gpg (134,43 MB)
Feb 2, 2017 12:12 PM: Starting - RemoteOperationGet
Feb 2, 2017 12:12 PM: RemoteOperationGet took 00:03:20.111
Feb 2, 2017 12:12 PM: Backend event: Get - Completed: duplicati-b6aa55475c7f64eb49475fe9ad75a7d60.dblock.7z.gpg (171,91 MB)
Feb 2, 2017 12:12 PM: Downloaded and decrypted 171,91 MB in 00:03:20.1098310, 879,69 KB/s
Feb 2, 2017 12:09 PM: Backend event: Get - Started: duplicati-b6aa55475c7f64eb49475fe9ad75a7d60.dblock.7z.gpg (171,91 MB)
--- Want to back this issue? **[Post a bounty on it!](https://www.bountysource.com/issues/41596531-compacting-a-backup-ends-with-error-while-running-backup_name-invalid-data-format?utm_campaign=plugin&utm_content=tracker%2F4870652&utm_medium=issues&utm_source=github)** We accept bounties via [Bountysource](https://www.bountysource.com/?utm_campaign=plugin&utm_content=tracker%2F4870652&utm_medium=issues&utm_source=github).The text was updated successfully, but these errors were encountered: