Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error in prune command #4689

Closed
progressify opened this issue Feb 7, 2024 · 11 comments
Closed

Error in prune command #4689

progressify opened this issue Feb 7, 2024 · 11 comments
Labels
category: prune state: need feedback waiting for feedback, e.g. from the submitter

Comments

@progressify
Copy link

Here you can see the log.
My snapshots are still safe? Or I need to do a new full backup?

root@internal:~# restic -r s3:<my-bucket> prune --json --password-file "/my-secret.txt"
counting files in repo
building new index for repo
[2:25] 100.00%  3480 / 3480 packs
incomplete pack file (will be removed): 000f496974820a3677ca65e6a5fe49afaa645aadc957baf175ae837e343a76bc
incomplete pack file (will be removed): 0085417a449933edc4318fbedcaea6ed306a5a3ada59c49a6f44e843fa94a7e3
incomplete pack file (will be removed): 00825eada172e559ff6184f8fb8df5d3b23d1c934b78b1f9dd3d6a9a014ea044
incomplete pack file (will be removed): 0081d9a82af7dbe3d66849fd16c3cc2a98144f72b426a108ea884efdcd953a83
incomplete pack file (will be removed): 0004cf9d3e202d0cd975b64ccf3fd9e625fbdcd09607c5d7e1780f69d8d96240
incomplete pack file (will be removed): 00a3e29a04d8f62d90dfd66a95a99a41c9ec3fd2496f982d6d15633dfbe43bd6
incomplete pack file (will be removed): 006078b13af29db699f0923e42f306bd69b2b3e716b9206978c69e14d6574095
incomplete pack file (will be removed): 0019f807347ed43002ef23c1d4750c91ee23a2253c91212bb0e5dd418fe910c8
incomplete pack file (will be removed): 005d30cbb781cfcfdc1b02c3d6d856da3a65aea57971cf4c69d5a30db51a5780
incomplete pack file (will be removed): 00b211e986d9a67b71a0371f7c688fdf2efd3398cd857485cda7ad03af26fc93

<-- cutted -->

incomplete pack file (will be removed): ffa0b04f84e8d84af31c8d8c496af390e96a83f24d354120697568a87b9d5caa
incomplete pack file (will be removed): ffad30a9defeff00450e543e514fb9363c576735a0e49d2fe301b1f77c862f79
incomplete pack file (will be removed): ffc7c303cd55909dea22f74bb894fb69f1db961325d038984313f09c47d9d244
incomplete pack file (will be removed): ffbfb671c3832afb45960ed392b770432f922ac1e0fd5bf2ddbda267bdd6c879
incomplete pack file (will be removed): ffc9ea889dcf5a040b5bd840bd31fe2749a74424e53af906a2807b2742d370ac
incomplete pack file (will be removed): ffcb41085b568f423430b1823b04885070e10b21fc0cbcf8693387c5fece30de
incomplete pack file (will be removed): ffd0e308bfa60c9e126303b97cfc458b47906dc649ba06e614e5475c1926ff8b
incomplete pack file (will be removed): ffd67c0650a7b89501ad1a69eb82bd0bb270a61100ea1b5e9c9d5d567bea94ed
incomplete pack file (will be removed): ffce55ace114254b66c79e9184aad0e3b7aff0d4171fd61e59fa07ce89346712
incomplete pack file (will be removed): ffdc613eda7bc91be5b854de6cc504be2e7b98222d2c39da4c865568238f8a84
incomplete pack file (will be removed): fff7227b3d2f0d73e510ca07b775303fccc74c566ddddfe8a8d0ef47b8a5f957
repository contains 29 packs (22151 blobs) with 67.394 MiB
processed 22151 blobs: 0 duplicate blobs, 0 B duplicate
load all snapshots
find data that is still in use for 10 snapshots
[0:04] 100.00%  10 / 10 snapshots
Fatal: number of used blobs is larger than number of available blobs!
Please report this error (along with the output of the 'prune' run) at
https://github.com/restic/restic/issues/new

In the attachments the full log
full.log

@MichaelEischer
Copy link
Member

MichaelEischer commented Feb 8, 2024

You're using an ancient restic version. Please upgrade to a recent version of restic and try running prune again.

My snapshots are still safe? Or I need to do a new full backup?

If the huge list of incomplete pack file is correct, then the repository is broken beyond repair. But I'd strongly suggest to use a recent restic version first, that might provide further insight on what's going on.

@MichaelEischer MichaelEischer added state: need feedback waiting for feedback, e.g. from the submitter category: prune labels Feb 8, 2024
@progressify
Copy link
Author

progressify commented Feb 9, 2024

root@ internal:~# restic version
restic 0.9.6 compiled with go1.12.12 on linux/amd64

I have installed restic with apt. How do you think I should install it?

Today I tried to run a new incremental backup and a new forget, after a prune command, the output is similar.
But if I run this command:

root@internal:~# restic -r s3:<my-bucket> check --read-data --password-file "/my-secret.txt"
using temporary cache in /tmp/restic-check-cache-749961570
repository 02c1c5d6 opened successfully, password is correct
created new cache in /tmp/restic-check-cache-749961570
create exclusive lock for repository
load indexes
check all packs
check snapshots, trees and blobs
read all data
[14:43] 100.00%  3635 / 3635 items
duration: 14:43
no errors were found

He don't see errors in the repo 🤔

@rawtaz
Copy link
Contributor

rawtaz commented Feb 9, 2024

root@ internal:~# restic version
restic 0.9.6 compiled with go1.12.12 on linux/amd64

I have installed restic with apt. How do you think I should install it?

Using a package manager to install your software is fine, but you have to be able to understand and identify when the package manager has very outdated versions of the software in the packages. Restic 0.9.6 was released 2019-11-22 and the current version right now is 0.16.4.

Either update your Debian to a newer version that has newer packages in its APT repositories, or use backports, or you can simply download and use the official restic releases that you find here on GitHub. They consist of one single binary, so you can place them wherever you want and run them without having to do any additional installation or configuration.

@progressify
Copy link
Author

progressify commented Feb 9, 2024

Ok thankyou, I proceed to update my installation!
I need to reset my repo or with a newer version of the installer my repo can be saved?

EDIT: I have updated to the latest restic. I have 2 doubts:

  1. I have done a new backup and now I see this message:
repository 02c1c5d6 opened (version 1)

It ok? Or I need to migrate something?

  1. After a forget command and a new prune this is the output:
root@internal:~# restic -r s3:<my-bucket> prune --password-file "/my-secret.txt"
repository 02c1c5d6 opened (version 1)
loading indexes...
[0:00] 100.00%  7 / 7 index files loaded
loading all snapshots...
finding data that is still in use for 9 snapshots
[0:02] 100.00%  9 / 9 snapshots
searching used packs...
collecting packs for deletion and repacking
[0:02] 100.00%  3641 / 3641 packs processed

to repack:         10674 blobs / 31.334 MiB
this removes:       1272 blobs / 14.140 MiB
to delete:           975 blobs / 1.967 GiB
total prune:        2247 blobs / 1.981 GiB
remaining:         95756 blobs / 17.698 GiB
unused size after prune: 352.125 MiB (1.94% of remaining size)

repacking packs
[0:02] 100.00%  14 / 14 packs repacked
rebuilding index
[0:05] 100.00%  3316 / 3316 packs processed
deleting obsolete index files
[0:00] 100.00%  7 / 7 files deleted
removing 327 old packs
[0:10] 100.00%  327 / 327 files deleted
done

🤔 I don't know if now it's all resolved

@rawtaz
Copy link
Contributor

rawtaz commented Feb 9, 2024

What does restic version show?

The repository 02c1c5d6 opened (version 1) looks fine.

The prune output looks fine. You can verify the entire repository including all the stored data by running the check --read-data command.

@progressify
Copy link
Author

now the vesion is:

root@internal:~# restic version
restic 0.16.4 compiled with go1.21.6 on linux/amd64

@rawtaz
Copy link
Contributor

rawtaz commented Feb 10, 2024

That's a good version. So did you run the check --read-data command?

@MichaelEischer
Copy link
Member

🤔 I don't know if now it's all resolved

If restic check --read-data using the recent restic version states that no errors were found, then your repository is fine. I have no idea why prune using the older restic version returned errors, but it's not really worth investigating further as we've made major changes to most parts of restic since then.

@progressify
Copy link
Author

Today I upgraded my repo to version 2 with the command in the docs and checked the data:

root@internal:~# restic -r s3:<my-bucket> check --read-data --password-file "/my-secret.txt"
using temporary cache in /tmp/restic-check-cache-2775047928
repository 02c1c5d6 opened (version 2, compression level auto)
created new cache in /tmp/restic-check-cache-2775047928
create exclusive lock for repository
load indexes
[0:01] 100.00%  1 / 1 index files loaded
check all packs
check snapshots, trees and blobs
[0:17] 100.00%  10 / 10 snapshots
read all data
Load(<data/d2449fafe9>, 5755210, 0) returned error, retrying after 519.106405ms: Missing file_id of a part
Load(<data/72ede63993>, 4487942, 0) returned error, retrying after 427.913282ms: Missing file_id of a part
Load(<data/72ede63993>, 4487942, 0) operation successful after 1 retries
Load(<data/d2449fafe9>, 5755210, 0) operation successful after 1 retries
Load(<data/0a4e9662c6>, 5338750, 0) returned error, retrying after 385.863911ms: ReadFull: stream error: stream ID 387; INTERNAL_ERROR; received from peer
Load(<data/0a4e9662c6>, 5338750, 0) operation successful after 1 retries
Load(<data/4cc9679678>, 6392372, 0) returned error, retrying after 567.861441ms: Missing file_id of a part
Load(<data/4cc9679678>, 6392372, 0) operation successful after 1 retries
Load(<data/cc0a2df9c9>, 4194892, 0) returned error, retrying after 540.138239ms: Missing file_id of a part
Load(<data/cc0a2df9c9>, 4194892, 0) operation successful after 1 retries
Load(<data/eca0410da5>, 4202107, 0) returned error, retrying after 281.707991ms: Missing file_id of a part
Load(<data/eca0410da5>, 4202107, 0) operation successful after 1 retries
Load(<data/8cacdfe8b0>, 4591760, 0) returned error, retrying after 546.004051ms: Missing file_id of a part
Load(<data/8cacdfe8b0>, 4591760, 0) operation successful after 1 retries
Load(<data/8cffb335b6>, 5444592, 0) returned error, retrying after 431.812875ms: Missing file_id of a part
Load(<data/8cffb335b6>, 5444592, 0) operation successful after 1 retries
Load(<data/7cdfdd903e>, 4913376, 0) returned error, retrying after 599.831075ms: Missing file_id of a part
Load(<data/7cdfdd903e>, 4913376, 0) operation successful after 1 retries
Load(<data/8cce206ea6>, 4728667, 0) returned error, retrying after 458.102423ms: Missing file_id of a part
Load(<data/8cce206ea6>, 4728667, 0) operation successful after 1 retries
Load(<data/8ce3547e87>, 5233294, 0) returned error, retrying after 746.950838ms: Missing file_id of a part
Load(<data/8ce3547e87>, 5233294, 0) operation successful after 1 retries
Load(<data/fc05ca0693>, 4376196, 0) returned error, retrying after 532.065345ms: Missing file_id of a part
Load(<data/fc05ca0693>, 4376196, 0) operation successful after 1 retries
Load(<data/bc7e139686>, 4677634, 0) returned error, retrying after 312.935174ms: Missing file_id of a part
Load(<data/bc7e139686>, 4677634, 0) operation successful after 1 retries
Load(<data/cca5089c4a>, 4201393, 0) returned error, retrying after 631.562655ms: Missing file_id of a part
Load(<data/cca5089c4a>, 4201393, 0) operation successful after 1 retries
Load(<data/1cb88bb9cf>, 4709930, 0) returned error, retrying after 282.739895ms: Missing file_id of a part
Load(<data/1cb88bb9cf>, 4709930, 0) operation successful after 1 retries
Load(<data/6dec38de30>, 4703028, 0) returned error, retrying after 663.045139ms: Missing file_id of a part
Load(<data/6dec38de30>, 4703028, 0) operation successful after 1 retries
Load(<data/2d3ec55ba3>, 4520181, 0) returned error, retrying after 681.582908ms: Missing file_id of a part
Load(<data/2d3ec55ba3>, 4520181, 0) operation successful after 1 retries
Load(<data/2d077a3b88>, 4717069, 0) returned error, retrying after 366.541706ms: Missing file_id of a part
Load(<data/9d721e3b6b>, 4553858, 0) returned error, retrying after 693.317967ms: Missing file_id of a part
Load(<data/9d721e3b6b>, 4553858, 0) operation successful after 1 retries
Load(<data/4dd77b43df>, 9474085, 0) returned error, retrying after 356.451257ms: Missing file_id of a part
Load(<data/4dd77b43df>, 9474085, 0) operation successful after 1 retries
Load(<data/9dc4203301>, 5902409, 0) returned error, retrying after 590.118858ms: Missing file_id of a part
Load(<data/9dc4203301>, 5902409, 0) operation successful after 1 retries
Load(<data/7de2246b89>, 5736409, 0) returned error, retrying after 657.583415ms: Missing file_id of a part
Load(<data/7de2246b89>, 5736409, 0) operation successful after 1 retries
Load(<data/2d077a3b88>, 4717069, 0) returned error, retrying after 1.118442381s: Missing file_id of a part
Load(<data/2d077a3b88>, 4717069, 0) operation successful after 2 retries
Load(<data/9dae300c60>, 4610384, 0) returned error, retrying after 677.844122ms: Missing file_id of a part
Load(<data/9dae300c60>, 4610384, 0) operation successful after 1 retries
Load(<data/8d049a4858>, 4677890, 0) returned error, retrying after 389.784417ms: Missing file_id of a part
Load(<data/8d049a4858>, 4677890, 0) operation successful after 1 retries
Load(<data/ede7fd48aa>, 4194892, 0) returned error, retrying after 713.810682ms: Missing file_id of a part
Load(<data/ede7fd48aa>, 4194892, 0) operation successful after 1 retries
Load(<data/4db32a68c4>, 4560307, 0) returned error, retrying after 427.242345ms: Missing file_id of a part
Load(<data/4db32a68c4>, 4560307, 0) operation successful after 1 retries
Load(<data/fdc7d4e394>, 4432428, 0) returned error, retrying after 647.296747ms: Missing file_id of a part
Load(<data/3daea8fff1>, 7326582, 0) returned error, retrying after 493.427785ms: Missing file_id of a part
Load(<data/3daea8fff1>, 7326582, 0) operation successful after 1 retries
Load(<data/0d9c9cd5ce>, 4354519, 0) returned error, retrying after 344.859347ms: Missing file_id of a part
Load(<data/0d2cb140db>, 6389209, 0) returned error, retrying after 373.89558ms: Missing file_id of a part
Load(<data/0d9c9cd5ce>, 4354519, 0) operation successful after 1 retries
Load(<data/0d2cb140db>, 6389209, 0) operation successful after 1 retries
Load(<data/9da018151a>, 4534758, 0) returned error, retrying after 478.519192ms: Missing file_id of a part
Load(<data/9da018151a>, 4534758, 0) operation successful after 1 retries
Load(<data/fdf45dd883>, 4578694, 0) returned error, retrying after 397.932807ms: Missing file_id of a part
Load(<data/fdf45dd883>, 4578694, 0) operation successful after 1 retries
Load(<data/cd9e0b5268>, 8388713, 0) returned error, retrying after 609.811128ms: Missing file_id of a part
Load(<data/cd9e0b5268>, 8388713, 0) operation successful after 1 retries
Load(<data/9d734b10a7>, 4232303, 0) returned error, retrying after 338.654495ms: Missing file_id of a part
Load(<data/9d734b10a7>, 4232303, 0) operation successful after 1 retries
Load(<data/4d13eaef99>, 4194892, 0) returned error, retrying after 677.993112ms: Missing file_id of a part
Load(<data/4d13eaef99>, 4194892, 0) operation successful after 1 retries
Load(<data/fdc7d4e394>, 4432428, 0) returned error, retrying after 968.148435ms: Missing file_id of a part
Load(<data/fdc7d4e394>, 4432428, 0) operation successful after 2 retries
Load(<data/2db3b0ec33>, 5293888, 0) returned error, retrying after 473.195018ms: Missing file_id of a part
Load(<data/2db3b0ec33>, 5293888, 0) operation successful after 1 retries
Load(<data/bdfe2b3aff>, 6189133, 0) returned error, retrying after 729.17508ms: Missing file_id of a part
Load(<data/aef282d5ff>, 5886097, 0) returned error, retrying after 325.936662ms: Missing file_id of a part
Load(<data/aef282d5ff>, 5886097, 0) operation successful after 1 retries
Load(<data/aeff07b0f4>, 16987301, 0) returned error, retrying after 512.179729ms: Missing file_id of a part
Load(<data/aef2156483>, 4302774, 0) returned error, retrying after 518.253607ms: Missing file_id of a part
Load(<data/aef2156483>, 4302774, 0) operation successful after 1 retries
Load(<data/bdfe2b3aff>, 6189133, 0) returned error, retrying after 905.291624ms: Missing file_id of a part
Load(<data/bdfe2b3aff>, 6189133, 0) operation successful after 2 retries
Load(<data/be5d70ea98>, 6142603, 0) returned error, retrying after 269.937763ms: Missing file_id of a part
Load(<data/aeff07b0f4>, 16987301, 0) operation successful after 1 retries
Load(<data/ce405cb8a7>, 4265156, 0) returned error, retrying after 456.255447ms: Missing file_id of a part
Load(<data/ce405cb8a7>, 4265156, 0) operation successful after 1 retries
Load(<data/2e64f7ba37>, 4542392, 0) returned error, retrying after 280.981031ms: Missing file_id of a part
Load(<data/be5d70ea98>, 6142603, 0) returned error, retrying after 1.000479395s: Missing file_id of a part
Load(<data/ce6d86ece0>, 8388713, 0) returned error, retrying after 318.78906ms: Missing file_id of a part
Load(<data/ce6d86ece0>, 8388713, 0) operation successful after 1 retries
Load(<data/be5d70ea98>, 6142603, 0) operation successful after 2 retries
Load(<data/0e181bd0d9>, 5844787, 0) returned error, retrying after 554.526395ms: Missing file_id of a part
Load(<data/0e181bd0d9>, 5844787, 0) operation successful after 1 retries
Load(<data/4eeee83830>, 4194892, 0) returned error, retrying after 376.67406ms: Missing file_id of a part
Load(<data/4eeee83830>, 4194892, 0) operation successful after 1 retries
Load(<data/2e64f7ba37>, 4542392, 0) returned error, retrying after 945.919793ms: Missing file_id of a part
Load(<data/2e64f7ba37>, 4542392, 0) operation successful after 2 retries
Load(<data/4ebd91fb30>, 4254729, 0) returned error, retrying after 427.221777ms: Missing file_id of a part
Load(<data/ce2b831a0d>, 5235484, 0) returned error, retrying after 262.341318ms: Missing file_id of a part
Load(<data/4ebd91fb30>, 4254729, 0) operation successful after 1 retries
Load(<data/ce2b831a0d>, 5235484, 0) operation successful after 1 retries
Load(<data/4e37af9c1e>, 5490273, 0) returned error, retrying after 583.394263ms: Missing file_id of a part
Load(<data/4e37af9c1e>, 5490273, 0) operation successful after 1 retries
Load(<data/5e19a3872a>, 4279944, 0) returned error, retrying after 514.126825ms: Missing file_id of a part
Load(<data/5e19a3872a>, 4279944, 0) operation successful after 1 retries
Load(<data/5e5e9d6cc1>, 6436687, 0) returned error, retrying after 355.752031ms: Missing file_id of a part
Load(<data/5e5e9d6cc1>, 6436687, 0) operation successful after 1 retries
Load(<data/4eda885602>, 4517414, 0) returned error, retrying after 735.368416ms: Missing file_id of a part
Load(<data/4eda885602>, 4517414, 0) operation successful after 1 retries
Load(<data/7ebee24db2>, 4747783, 0) returned error, retrying after 516.984623ms: Missing file_id of a part
Load(<data/7ebee24db2>, 4747783, 0) operation successful after 1 retries
Load(<data/2edd5629cf>, 4826546, 0) returned error, retrying after 440.292621ms: Missing file_id of a part
Load(<data/2edd5629cf>, 4826546, 0) operation successful after 1 retries
Load(<data/bee9546be5>, 12483933, 0) returned error, retrying after 387.032879ms: Missing file_id of a part
Load(<data/bee9546be5>, 12483933, 0) operation successful after 1 retries
Load(<data/ce75180d4e>, 6904615, 0) returned error, retrying after 406.274406ms: Missing file_id of a part
Load(<data/ce75180d4e>, 6904615, 0) operation successful after 1 retries
Load(<data/3e029b222a>, 4216823, 0) returned error, retrying after 739.634462ms: Missing file_id of a part
Load(<data/3e029b222a>, 4216823, 0) operation successful after 1 retries
Load(<data/7e7d0a693d>, 4761400, 0) returned error, retrying after 481.485927ms: Missing file_id of a part
Load(<data/7e7d0a693d>, 4761400, 0) operation successful after 1 retries
Load(<data/8e826b932e>, 5130976, 0) returned error, retrying after 536.185429ms: Missing file_id of a part
Load(<data/8e826b932e>, 5130976, 0) operation successful after 1 retries
Load(<data/0e52cb47a6>, 8388713, 0) returned error, retrying after 598.385653ms: Missing file_id of a part
Load(<data/0e52cb47a6>, 8388713, 0) operation successful after 1 retries
Load(<data/4e44018b5c>, 5728580, 0) returned error, retrying after 680.171273ms: Missing file_id of a part
Load(<data/4e44018b5c>, 5728580, 0) operation successful after 1 retries
Load(<data/8e3e579d37>, 5217165, 0) returned error, retrying after 561.515355ms: Missing file_id of a part
Load(<data/8e3e579d37>, 5217165, 0) operation successful after 1 retries
Load(<data/4e808b88c9>, 4447600, 0) returned error, retrying after 573.578163ms: Missing file_id of a part
Load(<data/4e808b88c9>, 4447600, 0) operation successful after 1 retries
Load(<data/dedb923cb1>, 5578718, 0) returned error, retrying after 604.72113ms: Missing file_id of a part
Load(<data/dedb923cb1>, 5578718, 0) operation successful after 1 retries
Load(<data/be1f393b27>, 4756395, 0) returned error, retrying after 743.949436ms: Missing file_id of a part
Load(<data/be1f393b27>, 4756395, 0) operation successful after 1 retries
Load(<data/5f5e4c998c>, 4402200, 0) returned error, retrying after 426.980751ms: Missing file_id of a part
Load(<data/5f5e4c998c>, 4402200, 0) operation successful after 1 retries
Load(<data/4fa6eb76c1>, 7628836, 0) returned error, retrying after 693.902963ms: Missing file_id of a part
Load(<data/4fa6eb76c1>, 7628836, 0) operation successful after 1 retries
Load(<data/4f0b427b2c>, 8388713, 0) returned error, retrying after 747.883184ms: Missing file_id of a part
Load(<data/4f0b427b2c>, 8388713, 0) operation successful after 1 retries
Load(<data/8fc5523207>, 4194892, 0) returned error, retrying after 575.190939ms: Missing file_id of a part
Load(<data/8fc5523207>, 4194892, 0) operation successful after 1 retries
Load(<data/5f5d00f99d>, 4495453, 0) returned error, retrying after 459.68695ms: Missing file_id of a part
Load(<data/5f5d00f99d>, 4495453, 0) operation successful after 1 retries
Load(<data/af53164904>, 11607717, 0) returned error, retrying after 582.87741ms: Missing file_id of a part
Load(<data/af53164904>, 11607717, 0) operation successful after 1 retries
Load(<data/8fc993779a>, 5664380, 0) returned error, retrying after 695.69417ms: Missing file_id of a part
Load(<data/8fc993779a>, 5664380, 0) operation successful after 1 retries
Load(<data/cfeb8b2856>, 4994540, 0) returned error, retrying after 422.929625ms: Missing file_id of a part
Load(<data/cfeb8b2856>, 4994540, 0) operation successful after 1 retries
Load(<data/ffce55ace1>, 5999171, 0) returned error, retrying after 659.787346ms: Missing file_id of a part
Load(<data/ffce55ace1>, 5999171, 0) operation successful after 1 retries
Load(<data/bfeedf1196>, 5218841, 0) returned error, retrying after 397.114879ms: Missing file_id of a part
Load(<data/bfeedf1196>, 5218841, 0) operation successful after 1 retries
Load(<data/cffae6a886>, 8025392, 0) returned error, retrying after 597.786516ms: Missing file_id of a part
Load(<data/cffae6a886>, 8025392, 0) operation successful after 1 retries
Load(<data/fff7227b3d>, 5034640, 0) returned error, retrying after 623.692183ms: Missing file_id of a part
Load(<data/fff7227b3d>, 5034640, 0) operation successful after 1 retries
Load(<data/8f13a54e36>, 5063229, 0) returned error, retrying after 655.309355ms: Missing file_id of a part
Load(<data/ff00028123>, 4404534, 0) returned error, retrying after 705.332844ms: Missing file_id of a part
Load(<data/ff00028123>, 4404534, 0) operation successful after 1 retries
Load(<data/9ff6ddefd0>, 4292202, 0) returned error, retrying after 698.626183ms: Missing file_id of a part
Load(<data/9ff6ddefd0>, 4292202, 0) operation successful after 1 retries
Load(<data/bf4a571c4c>, 4201004, 0) returned error, retrying after 605.010265ms: Missing file_id of a part
Load(<data/bf4a571c4c>, 4201004, 0) operation successful after 1 retries
Load(<data/8f13a54e36>, 5063229, 0) returned error, retrying after 446.680036ms: Missing file_id of a part
Load(<data/8f13a54e36>, 5063229, 0) operation successful after 2 retries
Load(<data/3f71fcd2b2>, 4728974, 0) returned error, retrying after 575.416478ms: Missing file_id of a part
Load(<data/3f71fcd2b2>, 4728974, 0) operation successful after 1 retries
Load(<data/8f06ac2312>, 7995107, 0) returned error, retrying after 628.299836ms: Missing file_id of a part
Load(<data/8f06ac2312>, 7995107, 0) operation successful after 1 retries
Load(<data/dfe08ab2d6>, 6060516, 0) returned error, retrying after 341.364568ms: Missing file_id of a part
Load(<data/dfd0af4ade>, 4204318, 0) returned error, retrying after 328.768055ms: Missing file_id of a part
Load(<data/dfd0af4ade>, 4204318, 0) operation successful after 1 retries
Load(<data/2f4321a2b9>, 4603831, 0) returned error, retrying after 659.397869ms: Missing file_id of a part
Load(<data/2f4321a2b9>, 4603831, 0) operation successful after 1 retries
Load(<data/dfe08ab2d6>, 6060516, 0) operation successful after 1 retries
[1:10:33] 100.00%  3239 / 3239 packs
no errors were found

I see some errors, but probably it is a bucket fault. It is not an AWS bucket and does not have good performance.

@MichaelEischer
Copy link
Member

I see some errors, but probably it is a bucket fault. It is not an AWS bucket and does not have good performance.

Yes, those errors are caused by the S3 storage and must be fixed there; there's nothing that can be done about that in restic. At the rate of errors thrown by that storage, it looks like its redundancy mechanisms are already overtaxed and it's just one minor problem away from actually losing data.

@progressify
Copy link
Author

progressify commented Feb 12, 2024

Thank you guys for your help <3

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: prune state: need feedback waiting for feedback, e.g. from the submitter
Projects
None yet
Development

No branches or pull requests

3 participants