Not downloading all files

[ryan-adler]

I have a Shared Library with over 300k photos and videos. When the sync is completed, I have only around 155k files in the target folder. How can I go about figuring out why the other half are not downloaded?

[mariomaz87]

I have the same issue on a Shared library

[skumka]

I have exactly the same.
44k Photos 900 Videos and icloudpd sees only 714.
They are recogenized as "recent". I have no idea per what that selection is done.
In Photos in iCloud there are 2k Recent Photos.

Interestingly, I tried to download files per Albums. It sees all photo inside the selected album to download, but nothing is downloaded.
See log:
2024-02-04 15:42:43 INFO Downloading album: Rok 2000-09 - Kreta
2024-02-04 15:42:45 DEBUG Authenticating...
2024-02-04 15:42:49 DEBUG Looking up all photos and videos from album Rok 2000-09 - Kreta...
2024-02-04 15:42:50 INFO Downloading 180 original photos and videos to /library ...
2024-02-04 15:42:51 INFO All photos have been downloaded
2024-02-04 15:42:51 INFO Synchronisation complete for user
2024-02-04 15:42:51 INFO Web cookie expires: 2024-04-04 @ 14:12:57
2024-02-04 15:42:51 INFO Multifactor authentication cookie expires: 2024-05-04 @ 14:15:20
2024-02-04 15:42:51 INFO Days remaining until expiration: 89
2024-02-04 15:42:51 INFO Synchronisation ended at 15:42:51
2024-02-04 15:42:51 INFO Total time taken: 00:00:08
2024-02-04 15:42:51 INFO Next synchronisation at 15:42:43

No one file exist on disk on the specified location, No such album is downloaded. Per what it sees :2024-02-04 15:42:51 INFO All photos have been downloaded ??????

[sgandon]

same issue with me, only the not shared photos are synchronized. The shared photos are ignored.

[boredazfcuk]

I have a Shared Library with over 300k photos and videos. When the sync is completed, I have only around 155k files in the target folder. How can I go about figuring out why the other half are not downloaded?

Is that how many items show in the shared library on icloud.com? It's my understanding that shared libraries on icloud.com only show the photos that were added by that Apple ID. I don't use shared libraries, so cannot confirm. This utility uses icloud.com as its source, so will only ever match what it sees on there.

[boredazfcuk]

same issue with me, only the not shared photos are synchronized. The shared photos are ignored.

This is expected behaviour. If you want to download 'All Photos' and the 'Shared Library' you will need to create two containers.

[boredazfcuk]

Actually 300k photos is a lot. Apple rotates filenames... IMG_000.HEIC... IMG_0001.HEIC... IMG_9999.HEIC... IMG_000.HEIC. This results in a limit of 10k photos per directory.

If you have your folder_structure set to none then you will have a single download folder and a limit of 10k files. if you have it set to {:Y}, then you'll have a limit of 10k photos per year. If those photos go back to 2007, you'll have a limit of about 160k photos.

With a library that large, you really should be looking at a folder structure of {:Y/M} which will have a limit of 10k photos per month, or even {:Y/M/D} which would give you a limit of 10k photos per day.

[ryan-adler]

Just to update this, I am now syncing both the private and shared libraries, and using the recommended date folder structure. It looks like all the files are downloaded, though of course it's hard to be sure.