WebDAV: Download should be flagged as failed when retry limit is reached

[merito]

1. What is not working as documented?

webdav import stucks after update to any release after 281123. It doesn't download any new files.

Links to the related documentation on docs.photoprism.app:

• https://docs.photoprism.app/user-guide/settings/sync/

2. How can we reproduce it?

Steps to reproduce the behavior:

1. Use webdav import on version 281123. Get some files, have at least one successful task done.
2. Upgrade to any newer version
3. The import task will never success again

3. What behavior do you expect?

Successful webdav import

4. What could be the cause of your problem?

It looks like it does not update the file list correctly and based on a cache/database tries to get nonexistent file. It doesn't handle file not found from webdav. I guess it's not my webdav server issue (Nextcloud), because with 281123 everything works fine. I use the same webdav integration with other tools and it works good.

5. Can you provide us with example files for testing, error logs, or screenshots?

In logs I can see this error:

2025-03-01 10:56:56.338949+00:00time="2025-03-01T10:56:56Z" level=debug msg="index: updating metadata"
2025-03-01 10:56:56.394828+00:00time="2025-03-01T10:56:56Z" level=info msg="sync: downloading from DIRECTORY"
2025-03-01 10:56:56.394997+00:00time="2025-03-01T10:56:56Z" level=debug msg="webdav: connecting to http://USER:PASSWORD@IP:PORT/remote.php/dav/files/USER"
2025-03-01 10:56:56.395050+00:00time="2025-03-01T10:56:56Z" level=debug msg="sync: downloading /DIRECTORY/Camera/2025/02/NON_EXISTING_FILE.jpg failed more than 3 times"
2025-03-01 10:57:00.044727+00:00time="2025-03-01T10:57:00Z"

6. Which software versions do you use?

(a) PhotoPrism Architecture & Build Number: AMD64, build 281123 and newer

(b) Database Type & Version: see details here https://github.com/truenas/apps/tree/master/trains/stable/photoprism/1.2.13

(c) Operating System Types & Versions: TrueNAS, latest version

(d) Browser Types & Versions: n/a

(e) Ad Blockers, Browser Plugins, and/or Firewall Software? n/a

7. On what kind of device is PhotoPrism installed?

This is especially important if you are reporting a performance, import, or indexing issue. You can skip this if you're reporting a problem you found in our public demo, or if it's a completely unrelated issue, such as incorrect page layout.

(a) Device / Processor Type: AMD GX420GI

(b) Physical Memory & Swap Space in GB 20 GB

(c) Storage Type: TrueNAS datasets, separate for import, originals and storage

(d) Anything else that might be helpful to know?

8. Do you use a Reverse Proxy, Firewall, VPN, or CDN?

N/A

[merito]

I can also find something like this periodically in logs

2025-03-01 13:01:15.902715+00:00time="2025-03-01T13:01:15Z" level=debug msg="sync: 405 Method Not Allowed: <error xmlns=\"DAV:\"><exception xmlns=\"http://sabredav.org/ns\">Internal Server Error</exception><message xmlns=\"http://sabredav.org/ns\">The server was unable to complete your request.		If this happens again, please send the technical details below to the server administrator.		More details can be found in the server log.</message><technical-details xmlns=\"http://sabredav.org/ns\">\n&#x9;&#x9;<remote-address xmlns=\"http://sabredav.org/ns\">172.16.3.1</remote-address>\n&#x9;&#x9;<request-id xmlns=\"http://sabredav.org/ns\">cj3J4UrR1HBCBgfacVxx</request-id>\n\n&#x9;&#x9;</technical-details></error>"

It's about DAV, maybe it's related. It looks like Nextcloud issue nextcloud/server#49002 but still it works well with 281123. I don't know if it is crucial.

[merito]

After update to 250228 and index cleanup

2025-03-01 15:02:33.697931+00:00time="2025-03-01T15:02:33Z" level=debug msg="index: updating metadata"
2025-03-01 15:02:33.780111+00:00time="2025-03-01T15:02:33Z" level=info msg="sync: downloading from InstantUpload"
2025-03-01 15:02:33.780248+00:00time="2025-03-01T15:02:33Z" level=debug msg="webdav: connecting to http://USER:PASSWORD@IP:PORT/remote.php/dav/files/USER"
2025-03-01 15:02:35.230188+00:00time="2025-03-01T15:02:35Z" level=error msg="webdav: 404 Not Found: ?error xmlns='DAV:'??exception xmlns='http://sabredav.org/ns'?Sabre?DAV?Exception?NotFound?/exception??message xmlns='http://sabredav.org/ns'?File with name /DIRECTORY/Camera/2025/02/NON_EXISTING_FILE.jpg could not be located?/message??/error?"

[lastzero]

@merito Have you tried restarting the process by clicking the Sync icon under Settings > Services? It should signal a sync problem with a changed icon or color. This way the upload/download should resume after an error.

[merito]

Hi @lastzero I've tried many times. It shows correct list of directories, but then again stucks on the non-existent file. It maybe looks more like an issue with permissions than webdav itself.

[lastzero]

This should be fixed/improved with the next preview build, which is also the release candidate for the stable version. Any help with testing is much appreciated!