[Bug]: Updating <dav> ... very slow with a lot of users #39769

kaystrobach · 2023-08-09T07:35:42Z

⚠️ This issue respects the following points: ⚠️

This is a bug, not a question or a configuration/webserver/proxy issue.
This issue is not already reported on Github OR Nextcloud Community Forum (I've searched it).
Nextcloud Server is up to date. See Maintenance and Release Schedule for supported versions.
I agree to follow Nextcloud's Code of Conduct.

Bug description

The Update step takes forever

the step is massively frustrating, as the logs do not display which entries are modified:

Steps to reproduce

install NC Enterprise 26.0.4
update to NC Enterprise 27.0.1

Expected behavior

Fast Update or background process

Installation method

Community Web installer on a VPS or web space

Nextcloud Server version

27

Operating system

Debian/Ubuntu

PHP engine version

PHP 8.2

Web server

Apache (supported)

Database engine version

MariaDB

Is this bug present after an update or on a fresh install?

Upgraded to a MAJOR version (ex. 22 to 23)

Are you using the Nextcloud Server Encryption module?

Encryption is Disabled

What user-backends are you using?

Default user-backend (database)
LDAP/ Active Directory
SSO - SAML
Other

Configuration report

Nextcloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade
{
    "system": {
        "objectstore_multibucket": {
            "class": "OC\\Files\\ObjectStore\\S3",
            "arguments": {
                "num_buckets": 1,
                "bucket": "nc-test-",
                "autocreate": true,
                "key": "***REMOVED SENSITIVE VALUE***",
                "secret": "***REMOVED SENSITIVE VALUE***",
                "hostname": "obs.eu-de.otc.t-systems.com",
                "use_ssl": true,
                "region": "eu-de"
            }
        },
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": [
            "***",
            "***",
            "***"
        ],
        "datadirectory": "***REMOVED SENSITIVE VALUE***",
        "skeletondirectory": "data\/skeleton\/",
        "dbtype": "mysql",
        "version": "26.0.4.3",
        "overwrite.cli.url": "https:\/\/wolke.schullogin.de",
        "dbname": "***REMOVED SENSITIVE VALUE***",
        "dbhost": "***REMOVED SENSITIVE VALUE***",
        "dbport": "",
        "dbtableprefix": "oc_",
        "mysql.utf8mb4": true,
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "installed": true,
        "instanceid": "***REMOVED SENSITIVE VALUE***",
        "debug": false,
        "default_locale": "de_DE",
        "default_language": "de",
        "mail_from_address": "***REMOVED SENSITIVE VALUE***",
        "mail_smtpmode": "smtp",
        "mail_sendmailmode": "smtp",
        "mail_domain": "***REMOVED SENSITIVE VALUE***",
        "mail_smtpauthtype": "PLAIN",
        "mail_smtpauth": 1,
        "mail_smtphost": "***REMOVED SENSITIVE VALUE***",
        "mail_smtpport": "25",
        "mail_smtpname": "***REMOVED SENSITIVE VALUE***",
        "mail_smtppassword": "***REMOVED SENSITIVE VALUE***",
        "redis": {
            "host": "***REMOVED SENSITIVE VALUE***",
            "port": 0,
            "timeout": 1.5
        },
        "memcache.local": "\\OC\\Memcache\\APCu",
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "theme": "",
        "loglevel": 0,
        "maintenance": true,
        "updater.server.url": "https:\/\/updates.nextcloud.com\/customers\.../",
        "app_install_overwrite": [
            "circles",
            "documentserver_community"
        ],
        "updater.release.channel": "enterprise",
        "default_phone_region": "DE",
        "sentry.dsn": "***REMOVED SENSITIVE VALUE***",
        "defaultapp": "files"
    }
}

List of activated Apps

Nextcloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade
Enabled:
  - activity: 2.19.0
  - admin_audit: 1.16.0
  - announcementcenter: 6.6.1
  - bruteforcesettings: 2.6.0
  - circles: 27.0.1
  - cloud_federation_api: 1.10.0
  - comments: 1.16.0
  - contacts: 5.3.2
  - contactsinteraction: 1.7.0
  - dashboard: 7.6.0
  - dav: 1.25.0
  - federatedfilesharing: 1.16.0
  - federation: 1.17.0
  - files: 1.22.0
  - files_antivirus: 5.2.1
  - files_pdfviewer: 2.7.0
  - files_sharing: 1.18.0
  - files_trashbin: 1.16.0
  - files_versions: 1.19.1
  - firstrunwizard: 2.15.0
  - logreader: 2.11.0
  - lookup_server_connector: 1.15.0
  - nextcloud_announcements: 1.15.0
  - notes: 4.8.1
  - notifications: 2.14.0
  - oauth2: 1.15.1
  - photos: 2.3.0
  - previewgenerator: 5.3.0
  - privacy: 1.10.0
  - provisioning_api: 1.16.0
  - quota_warning: 1.17.0
  - recommendations: 1.5.0
  - related_resources: 1.1.0
  - serverinfo: 1.16.0
  - settings: 1.8.0
  - sharebymail: 1.16.0
  - support: 1.9.0
  - survey_client: 1.14.0
  - systemtags: 1.16.0
  - text: 3.7.2
  - theming: 2.1.1
  - twofactor_backupcodes: 1.15.0
  - updatenotification: 1.16.0
  - user_saml: 5.2.1
  - user_status: 1.6.0
  - viewer: 1.10.0
  - weather_status: 1.6.0
  - workflowengine: 2.8.0
Disabled:
  - approval: 1.1.0 (installed 1.1.0)
  - bbb: 2.5.0 (installed 2.5.0)
  - encryption: 2.15.0
  - external: 5.1.0 (installed 5.1.0)
  - files_accesscontrol: 1.16.0 (installed 1.16.0)
  - files_confidential: 1.0.3
  - files_downloadactivity: 1.16.0 (installed 1.16.0)
  - files_external: 1.19.0
  - files_lock: 27.0.0 (installed 27.0.0)
  - files_rightclick: 1.6.0 (installed 1.3.0)
  - globalsiteselector: 2.4.3
  - impersonate: 1.13.1 (installed 1.13.1)
  - onlyoffice: 7.8.0 (installed 7.8.0)
  - password_policy: 1.17.0 (installed 1.15.0)
  - suspicious_login: 5.0.0
  - twofactor_totp: 9.0.0
  - user_ldap: 1.17.0

Nextcloud Signing status

not possible due to maintenance mode

Nextcloud Logs

{"reqId":"CvpSmDdyZsVDkPMhVqWb","level":0,"time":"2023-08-09T07:34:12+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"Automatic conversion of false to array is deprecated at /export/htdocs/nextcloud/lib/private/Files/Stream/SeekableHttpStream.php#222","userAgent":"--","version":"26.0.4.3","data":{"app":"PHP"}}
{"reqId":"CvpSmDdyZsVDkPMhVqWb","level":0,"time":"2023-08-09T07:34:12+00:00","remoteAddr":"","user":"--","app":"dav","method":"","url":"--","message":"Activity generated for a changed card in addressbook 3","userAgent":"--","version":"26.0.4.3","data":{"app":"dav"}}
{"reqId":"CvpSmDdyZsVDkPMhVqWb","level":0,"time":"2023-08-09T07:34:12+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"Automatic conversion of false to array is deprecated at /export/htdocs/nextcloud/lib/private/Files/Stream/SeekableHttpStream.php#222","userAgent":"--","version":"26.0.4.3","data":{"app":"PHP"}}
{"reqId":"CvpSmDdyZsVDkPMhVqWb","level":0,"time":"2023-08-09T07:34:12+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"Automatic conversion of false to array is deprecated at /export/htdocs/nextcloud/lib/private/Files/Stream/SeekableHttpStream.php#222","userAgent":"--","version":"26.0.4.3","data":{"app":"PHP"}}
{"reqId":"CvpSmDdyZsVDkPMhVqWb","level":0,"time":"2023-08-09T07:34:12+00:00","remoteAddr":"","user":"--","app":"dav","method":"","url":"--","message":"Activity generated for a changed card in addressbook 3","userAgent":"--","version":"26.0.4.3","data":{"app":"dav"}}
{"reqId":"CvpSmDdyZsVDkPMhVqWb","level":0,"time":"2023-08-09T07:34:12+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"Automatic conversion of false to array is deprecated at /export/htdocs/nextcloud/lib/private/Files/Stream/SeekableHttpStream.php#222","userAgent":"--","version":"26.0.4.3","data":{"app":"PHP"}}
{"reqId":"CvpSmDdyZsVDkPMhVqWb","level":0,"time":"2023-08-09T07:34:12+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"Automatic conversion of false to array is deprecated at /export/htdocs/nextcloud/lib/private/Files/Stream/SeekableHttpStream.php#222","userAgent":"--","version":"26.0.4.3","data":{"app":"PHP"}}
{"reqId":"CvpSmDdyZsVDkPMhVqWb","level":0,"time":"2023-08-09T07:34:12+00:00","remoteAddr":"","user":"--","app":"dav","method":"","url":"--","message":"Activity generated for a changed card in addressbook 3","userAgent":"--","version":"26.0.4.3","data":{"app":"dav"}}
{"reqId":"CvpSmDdyZsVDkPMhVqWb","level":0,"time":"2023-08-09T07:34:13+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"Automatic conversion of false to array is deprecated at /export/htdocs/nextcloud/lib/private/Files/Stream/SeekableHttpStream.php#222","userAgent":"--","version":"26.0.4.3","data":{"app":"PHP"}}
{"reqId":"CvpSmDdyZsVDkPMhVqWb","level":0,"time":"2023-08-09T07:34:13+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"Automatic conversion of false to array is deprecated at /export/htdocs/nextcloud/lib/private/Files/Stream/SeekableHttpStream.php#222","userAgent":"--","version":"26.0.4.3","data":{"app":"PHP"}}
{"reqId":"CvpSmDdyZsVDkPMhVqWb","level":0,"time":"2023-08-09T07:34:13+00:00","remoteAddr":"","user":"--","app":"dav","method":"","url":"--","message":"Activity generated for a changed card in addressbook 3","userAgent":"--","version":"26.0.4.3","data":{"app":"dav"}}
{"reqId":"CvpSmDdyZsVDkPMhVqWb","level":0,"time":"2023-08-09T07:34:14+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"Automatic conversion of false to array is deprecated at /export/htdocs/nextcloud/lib/private/Files/Stream/SeekableHttpStream.php#222","userAgent":"--","version":"26.0.4.3","data":{"app":"PHP"}}
{"reqId":"CvpSmDdyZsVDkPMhVqWb","level":0,"time":"2023-08-09T07:34:14+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"Automatic conversion of false to array is deprecated at /export/htdocs/nextcloud/lib/private/Files/Stream/SeekableHttpStream.php#222","userAgent":"--","version":"26.0.4.3","data":{"app":"PHP"}}



### Additional info

Maybe related to 

* https://github.com/nextcloud/server/issues/39744

The text was updated successfully, but these errors were encountered:

ChristophWurst · 2023-08-09T09:32:06Z

Duplicate of #39744

Thanks for the report

kaystrobach · 2023-08-09T09:59:47Z

No, we don’t use ldap here

ChristophWurst · 2023-08-09T10:06:50Z

It is the same problem nevertheless

kaystrobach · 2023-08-09T10:15:07Z

Maybe the source of the problem is the same, but the prerequisites are not similar.

kaystrobach · 2023-08-09T10:16:34Z

if it's the same problem, maybe a relation is enough.

miaulalala · 2023-08-16T13:20:24Z

Do you please have a user guesstimate for me @kaystrobach ? Just so we can adjust the workflow accordingly as described here #39744 (comment)

Don't want to do too little if it's not neccessary, but also don't want to be overconfident in my numbers.

kaystrobach · 2023-08-16T13:30:58Z

Do you please have a user guesstimate for me @kaystrobach ? Just so we can adjust the workflow accordingly as described here #39744 (comment)

Don't want to do too little if it's not neccessary, but also don't want to be overconfident in my numbers.

15k Users over 3h for that single step

kaystrobach added 0. Needs triage Pending check for reproducibility or if it fits our roadmap bug labels Aug 9, 2023

szaimen added the 27-feedback label Aug 9, 2023

ChristophWurst closed this as not planned Won't fix, can't repro, duplicate, stale Aug 9, 2023

ChristophWurst reopened this Aug 9, 2023

solracsf mentioned this issue Aug 12, 2023

[Bug]: <dav> upgrade step takes hours when server connected to large LDAP directory, or has hundreds of users #39744

Closed

8 tasks

miaulalala mentioned this issue Aug 16, 2023

fix(CardDAV): only run upgrade sync if 1000 users or less #39911

Merged

5 tasks

joshtrichards added feature: install and update feature: carddav Related to CardDAV internals performance 🚀 labels Aug 23, 2023

kesselb closed this as completed in #39911 Aug 27, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Bug]: Updating <dav> ... very slow with a lot of users #39769

[Bug]: Updating <dav> ... very slow with a lot of users #39769

kaystrobach commented Aug 9, 2023

ChristophWurst commented Aug 9, 2023

kaystrobach commented Aug 9, 2023

ChristophWurst commented Aug 9, 2023

kaystrobach commented Aug 9, 2023

kaystrobach commented Aug 9, 2023

miaulalala commented Aug 16, 2023

kaystrobach commented Aug 16, 2023 •

edited

[Bug]: Updating <dav> ... very slow with a lot of users #39769

[Bug]: Updating <dav> ... very slow with a lot of users #39769

Comments

kaystrobach commented Aug 9, 2023

⚠️ This issue respects the following points: ⚠️

Bug description

Steps to reproduce

Expected behavior

Installation method

Nextcloud Server version

Operating system

PHP engine version

Web server

Database engine version

Is this bug present after an update or on a fresh install?

Are you using the Nextcloud Server Encryption module?

What user-backends are you using?

Configuration report

List of activated Apps

Nextcloud Signing status

Nextcloud Logs

ChristophWurst commented Aug 9, 2023

kaystrobach commented Aug 9, 2023

ChristophWurst commented Aug 9, 2023

kaystrobach commented Aug 9, 2023

kaystrobach commented Aug 9, 2023

miaulalala commented Aug 16, 2023

kaystrobach commented Aug 16, 2023 • edited

kaystrobach commented Aug 16, 2023 •

edited