Unprompted interrupted sync with nexcloud bookmarks on greater amount of bookmarks

[afischer211]

Which version of floccus are you using?

4.17.0

Sync method

Nextcloud Bookmarks

Which browser are you using? In case you are using the phone App, specify the Android or iOS version and device please.

Chromium-based (current version of Vivaldi)

Which version of Nextcloud Bookmarks are you using? (if relevant)

11.0.1

Which version of Nextcloud? (if relevant)

24.0.4

What kind of WebDAV server are you using? (if relevant)

No response

Describe the Bug

I try to sync a bookmark-folder with more than 1000 bookmarks. With firefox it runs successful, with chrome and vivaldi it fails with "E027: Sync process was interrupted"
A second folder (separate floccus account) with less bookmarks syncs successful.

Expected Behavior

Sync the bookmarks without errors.

To Reproduce

Create a folder with many bookmarks (more than 1000) and try to sync it (download or merge).

Debug log provided

• I have provided a debug log file

[afischer211]

Can I configure timeouts or count of retries?`May be the bookmark-app inside Nextcloud is to slow?

[marcelklehr]

There is a handler in floccus that detects when the computer goes to sleep. Perhaps that is triggered for you. This only happens when a 2s interval has not been called for 12s, though, which I find unlikely to ever happen when the computer hasn't been asleep.

[marcelklehr]

A timeout of Nextcloud should not cause an interrupted sync error. Interrupted sync generally only happens when you manually cancel a sync run, or the computer has woken up from sleep, or you closed the browser during a sync run.

[afischer211]

Hmmh, I run the sync (runs many many minutes until error) - in the log-file I see misc actions and the last line is the message about the aborted sync. So the sync seems to abort himself without my interaction.

[vitorhmcorreia]

Hello,

I've recently migrated to floccus using nextcloud 26, syncing on Edge (all of which are running the latest available versions as of this date), and I'm having the same behaviour originally described in the ticket.

I am trying to sync over 100k bookmarks and it's driving me mad :)
I've tested multiple iterations of settings, as well as chrome and going back and forth from direct nextcloud syncing and webdav.

Since the last post, have there been any developments or, at least, an understanding of what may be happening?

Cheers, thanks!

[marcelklehr]

trying to sync over 100k
[...]
an understanding of what may be happening?

That's alot of bookmarks. My guess would be the extension process crashes due to memory consumption.

[pmorch]

My experience using it on Android:

Nextcloud Hub 5 (27.0.0)
Nextcloud bookmarks: 13.0.1
Floccus Android App installed today, last update March 24, 2023. I was not able to use the app to see the app version or to find it in Google Play.

I have 4k+ bookmarks and adding a new bookmark looks like it takes a couple of seconds after I hit the "Save" button (which by itself is too long). After that I see the list of bookmarks (without my new bookmark). After another couple of seconds, the sync process starts.

The sync process takes multiple minutes (I'd estimate 5 minutes).

I did not expect this to take multiple minutes to sync a single new bookmark. Downloading an export from nextcloud is virtually instant and in the end I have an export file of about 1MB.

During and after sync process the app is unresponstive. After multiple minutes , I see
This screenshot: E027SyncProcessWasInterrupted. With what looks like hundreds of pages of the same error message.

After which I have no choice but to kill the app. If I restart the app, it is very slow. I had no option but to uninstall the app again.

So in short: I was not able to use the app.

[marcelklehr]

I've just tested syncing with Nextcloud Bookmarks on Chrome with 88K bookmarks and it works quite well. Takes 1+GB of RAM, though. I haven't tested this in the android app, yet, though.

[vitorhmcorreia]

I'm still having issues with this.

On the dev console I can see the following:

Syncing failed with Too many pending tasks in queue list
Too many pending tasks in queue list
(...)
Too many pending tasks in queue list
E035: Failed to create the following bookmark on the server: [object Object]
E035: Failed to create the following bookmark on the server: [object Object]
E035: Failed to create the following bookmark on the server: [object Object]
E035: Failed to create the following bookmark on the server: [object Object]
E017: Network error: Check your network connection and your account details
Too many pending tasks in queue list

I'm attaching the floccus log, in case it helps. I've edited the file to remove the URLs for the bookmarks it's adding, and removed any sensitive information.

floccus-5.1.0-2024-05-14-full.log

I'm using the latest version of Nextcloud Bookmarks & Server, Floccus and Edge.

EDIT: all browser or OS network blockers were disabled during testing.

[marcelklehr]

@vitorhmcorreia Thank you for getting back to me and providing details! 💙 The logs make it look like it's just flooding the server with too many requests. I added some concurrency limits recently to avoid this. v5.1.2 will arrive on Edge soon, I hope.

[vitorhmcorreia]

@marcelklehr awesome news 🥳, I'll keep you in the loop with my findings.

[marcelklehr]

I can reproduce the problems on Android. It doesn't seem to be an OOM issue. More about responsiveness

[vitorhmcorreia]

@marcelklehr awesome news 🥳, I'll keep you in the loop with my findings.

@marcelklehr happy to report that the latest version of floccus is working brilliantly with my awful amount of bookmarks 😂
truly appreciate your work!

[marcelklehr]

Closing as the original issue seems to have been resolved. @pmorch please open a separate issue if this is still happening for you on Android 💙