Google takeout import failed 2 at the same point after aprox 45.000 photos.

[BeardmanDaniel]

Hello,

I would like to start by saying thanks for the script. It's amazing, quick and does a very good job at keeping metadata and all the details from gphotos.

With that said, i still encounter a problem, twice at the same point. After doing some smaller batches from .zip or from unziped folders, i tried doing in bulk for my whole gphotos library which is ~350gb with 124k assets.
First time it failed after 44k photos with 1k duplicates (from my previous tries).

Second time it failed excatly after 44 + 1k from previous attempt.

Both times with the same message.
Both times i also had 4 errors during upload and 79 unsupported files. Can these errors be related? Could i see those errors? What about the unsupported files?

This is the last log:
│ZTE_MiFavor_UI_5.0__by_AREA39-X~03.jpg error=AssetUpload, POST, http://XXXXX/api/assets │ │Post "http://XXXXX/api/assets": context deadline exceeded (Client.Timeout exceeded while awaiting │ │headers)

Thank you!

PS:
I expanded the terminal window and managed to see all 4 errors, i still don't know how to scroll it further though.

│2025-03-11 08:47:29 ERR upload error file=takeout-20250309T120917Z-006:Takeout/Google Photos/Photos from 2017/ │
│ZTE_MiFavor_UI_5.0__by_AREA39-X.jpg error=AssetUpload, POST, http://XXXXX/api/assets, 400 Bad Request │
│Multipart: Malformed part header │
│ │
│2025-03-11 08:52:29 ERR upload error file=takeout-20250309T120917Z-006:Takeout/Google Photos/Photos from 2017/ │
│ZTE_MiFavor_UI_5.0__by_AREA39-X01.jpg error=AssetUpload, POST, http://XXXXX/api/assets │
│Post "http://XXXXX/api/assets": context deadline exceeded (Client.Timeout exceeded while awaiting headers) │
│ │
│2025-03-11 08:52:29 ERR upload error file=takeout-20250309T120917Z-006:Takeout/Google Photos/Photos from 2017/ │
│ZTE_MiFavor_UI_5.0__by_AREA39-X02.jpg error=AssetUpload, POST, http://XXXXX/api/assets, 400 Bad Request │
│Multipart: Malformed part header │
│ │
│2025-03-11 08:57:29 ERR upload error file=takeout-20250309T120917Z-006:Takeout/Google Photos/Photos from 2017/ │
│ZTE_MiFavor_UI_5.0__by_AREA39-X~03.jpg error=AssetUpload, POST, http://XXXXX/api/assets │
│Post "http://XXXXX/api/assets": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

[BeardmanDaniel]

There was a problem with some pictures.
I stored in Gphotos some "wallpaper" photos form different webisites. One of those photos were crashing the script.

I used 7z d "pathtoZip" -r "ZTE*" to remove the photos and then retried. It worked.

Sorry for this.

[simulot]

Thanks for reporting.
Anyway there is a bug that need to be fixed!

[simulot]

The name of the file is not the problem. Could you share the file ZTE_MiFavor_UI_5.0__by_AREA39-X.jpg ?

[BeardmanDaniel]

Yes, luckily the takeout it's still available :))

I deleted from everywhere in my gphotos account and also from the archive i had locally that i used to import it to immich.

But i am re downloading now the archive from google photos and i will give it to you when it's done.

[BeardmanDaniel]

ZTE_MiFavor_UI_5.0__by_AREA39-X.jpg.supplement.json
Hello, i uploaded the file + json

Also, would you have time to check this question and maybe help me with an answer?
https://www.reddit.com/r/immich/comments/1j8vcol/how_to_interpret_immichgo_migration_data/

There are some differences between the files in immich and my upload summary.

thank you!

[simulot]

Nailed!

 "title": "ZTE_MiFavor_UI_5.0\n_by_AREA39-X.jpg",

Look the \n in the tile... This explain the error
Linked to #766

[BeardmanDaniel]

Nice! so no bug. just weir naming in the title.. :D