[Bug]: Files and folders not reliably showing up for groupfolders via WebGUI (Dav) resp. WebDAV

[dr-christoph-schneider]

⚠️ This issue respects the following points: ⚠️

• This is a bug, not a question or a configuration/webserver/proxy issue.
• This issue is not already reported on Github OR Nextcloud Community Forum (I've searched it).
• Nextcloud Server is up to date. See Maintenance and Release Schedule for supported versions.
• I agree to follow Nextcloud's Code of Conduct.

Bug description

We are struggling for already a while with not reliable showing up of files and folders specifically for so called groupfolders.

For the users it gets frustrating as you can never be sure if your files/folders show up or not - if you re-assign the Dav/WebDAV-request for a specific path-string, it seems to be a grab bag which files/folders come along in the response.

This messy behaviour comes along both the WebGUI (using the dav/files-Module) but also along the WebDav purely!

See attached the screencast illustrating this issue.

Steps to reproduce

1. Create groupfolder
2. Fill with content
3. Access the groupfodler content via WebGUI or WebDAV

Expected behavior

All files and fodlers should alawys show up reliably.

Nextcloud Server version

29

Operating system

Debian/Ubuntu

PHP engine version

PHP 8.1

Web server

Apache (supported)

Database engine version

PostgreSQL

Is this bug present after an update or on a fresh install?

Upgraded to a MAJOR version (ex. 28 to 29)

Are you using the Nextcloud Server Encryption module?

None

What user-backends are you using?

• Default user-backend (database)
• LDAP/ Active Directory
• SSO - SAML
• Other

Configuration report

{
    "system": {
        "instanceid": "***REMOVED SENSITIVE VALUE***",
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": [
            "cloud.***REMOVED SENSITIVE VALUE***.de",
            "192.168.253.1"
        ],
        "debug": false,
        "defaultapp": "files",
        "default_language": "de",
        "default_locale": "de_DE",
        "default_phone_region": "de",
        "datadirectory": "***REMOVED SENSITIVE VALUE***",
        "dbtype": "pgsql",
        "version": "29.0.8.1",
        "overwrite.cli.url": "https:\/\/cloud.***REMOVED SENSITIVE VALUE***de",
        "overwritehost": "cloud.***REMOVED SENSITIVE VALUE***.de",
        "overwriteprotocol": "https",
        "dbname": "***REMOVED SENSITIVE VALUE***",
        "dbhost": "***REMOVED SENSITIVE VALUE***",
        "dbport": "",
        "dbtableprefix": "oc_",
        "mysql.utf8mb4": true,
        "dbpersistent": true,
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "installed": true,
        "maintenance_window_start": 1,
        "maintenance": false,
        "mail_from_address": "***REMOVED SENSITIVE VALUE***",
        "mail_smtpmode": "smtp",
        "mail_sendmailmode": "smtp",
        "mail_domain": "***REMOVED SENSITIVE VALUE***",
        "mail_smtpauthtype": "LOGIN",
        "mail_smtpauth": 1,
        "mail_smtphost": "***REMOVED SENSITIVE VALUE***",
        "mail_smtpname": "***REMOVED SENSITIVE VALUE***",
        "mail_smtppassword": "***REMOVED SENSITIVE VALUE***",
        "mail_smtpsecure": "ssl",
        "htaccess.RewriteBase": "\/",
        "mail_smtpport": "465",
        "filelocking.enabled": "true",
        "memcache.local": "\\OC\\Memcache\\APCu",
        "memcache.distributed": "\\OC\\Memcache\\Redis",
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "redis": {
            "host": "***REMOVED SENSITIVE VALUE***",
            "port": 6379,
            "password": "***REMOVED SENSITIVE VALUE***",
            "timeout": 1.5
        },
        "share_folder": "\/Freigaben",
        "skeletondirectory": "",
        "theme": "",
        "loglevel": 2,
        "data-fingerprint": "259c283b5f65c9bec18c6eb1b011e604",
        "allow_local_remote_servers": "1",
        "app_install_overwrite": [
            "files_videoplayer",
            "accessibility",
            "pdfdraw",
            "epubreader",
            "files_downloadactivity"
        ],
        "enable_previews": true,
        "enabledPreviewProviders": [
            "OC\\Preview\\Imaginary",
            "OC\\Preview\\PNG",
            "OC\\Preview\\JPEG",
            "OC\\Preview\\TIF",
            "OC\\Preview\\TIFF",
            "OC\\Preview\\GIF",
            "OC\\Preview\\HEIC",
            "OC\\Preview\\BMP",
            "OC\\Preview\\XBitmap",
            "OC\\Preview\\MP3",
            "OC\\Preview\\TXT",
            "OC\\Preview\\MarkDown",
            "OC\\Preview\\MP4",
            "OC\\Preview\\PDF"
        ],
        "preview_imaginary_url": "***REMOVED SENSITIVE VALUE***",
        "jpeg_quality": "70",
        "preview_max_x": "1024",
        "preview_max_y": "1024",
        "preview_max_memory": -1,
        "preview_max_filesize_image": -1,
        "preview_concurrency_all": "4",
        "preview_concurrency_new": "2"
    }
}

List of activated Apps

Enabled:
  - activity: 2.21.1
  - admin_audit: 1.19.0
  - bruteforcesettings: 2.9.0
  - calendar: 4.7.16
  - cfg_share_links: 6.1.1
  - circles: 29.0.0-dev
  - cloud_federation_api: 1.12.0
  - comments: 1.19.0
  - contacts: 6.0.0
  - contactsinteraction: 1.10.0
  - dashboard: 7.9.0
  - dav: 1.30.1
  - federatedfilesharing: 1.19.0
  - files: 2.1.1
  - files_3dmodelviewer: 0.0.14
  - files_downloadactivity: 1.17.0
  - files_downloadlimit: 2.0.0
  - files_fulltextsearch: 29.0.1
  - files_pdfviewer: 2.10.0
  - files_reminders: 1.2.0
  - files_sharing: 1.21.0
  - files_trashbin: 1.19.0
  - files_versions: 1.22.0
  - firstrunwizard: 2.18.0
  - forms: 4.3.2
  - fulltextsearch: 29.0.1
  - fulltextsearch_elasticsearch: 29.0.1
  - groupfolders: 17.0.5
  - integration_openproject: 2.7.0
  - integration_zammad: 3.0.1
  - logreader: 2.14.0
  - lookup_server_connector: 1.17.0
  - mail: 3.7.9
  - maps: 1.4.0
  - metadata: 0.21.0
  - nextcloud_announcements: 1.18.0
  - notifications: 2.17.0
  - oauth2: 1.17.1
  - onlyoffice: 9.5.0
  - password_policy: 1.19.0
  - photos: 2.5.0
  - polls: 7.2.4
  - previewgenerator: 5.6.0
  - privacy: 1.13.0
  - provisioning_api: 1.19.0
  - recommendations: 2.1.0
  - related_resources: 1.4.0
  - root_cache_cleaner: 0.1.8
  - serverinfo: 1.19.0
  - settings: 1.12.0
  - sharebymail: 1.19.0
  - spreed: 19.0.10
  - support: 1.12.0
  - survey_client: 1.17.0
  - systemtags: 1.19.0
  - text: 3.10.1
  - theming: 2.4.0
  - twofactor_backupcodes: 1.18.0
  - updatenotification: 1.19.1
  - user_status: 1.9.0
  - viewer: 2.3.0
  - weather_status: 1.9.0
  - welcome: 1.2.0
  - workflowengine: 2.11.0
Disabled:
  - encryption: 2.17.0 (installed 2.17.0)
  - federation: 1.19.0 (installed 1.17.0)
  - files_external: 1.21.0
  - files_fulltextsearch_tesseract: 27.0.0 (installed 27.0.0)
  - files_rightclick: 0.15.1 (installed 1.6.0)
  - integration_ews: 1.0.37 (installed 1.0.37)
  - suspicious_login: 7.0.0
  - twofactor_totp: 11.0.0-dev
  - user_ldap: 1.20.0 (installed 1.20.0)

Nextcloud Signing status

No errors have been found.

Nextcloud Logs

{"reqId":"Z1LvVJe87aq4g2V9sW8A","level":4,"time":"2024-10-25T11:22:55+00:00","remoteAddr":"79.192.252.169","user":"--","app":"onlyoffice","method":"GET","url":"/ocs/v2.php/apps/onlyoffice/api/v1/config/3452673?shareToken=P9NKNigHMEPX7Aw&inframe=true","message":"getShare: share not found: 1810","userAgent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36","version":"29.0.8.1","data":{"app":"onlyoffice"}}
{"reqId":"Xc2YmHQTjwmOMbkKvkrK","level":2,"time":"2024-10-25T11:30:04+00:00","remoteAddr":"","user":"--","app":"files","method":"","url":"--","message":"User ***REMOVED SENSITIVE VALUE*** still has unscanned files after running background scan, background scan might be stopped prematurely","userAgent":"--","version":"29.0.8.1","data":{"app":"files"}}
{"reqId":"QggvvsWi759EsM2Mi1Hq","level":2,"time":"2024-10-25T11:45:03+00:00","remoteAddr":"","user":"--","app":"files","method":"","url":"--","message":"User ***REMOVED SENSITIVE VALUE*** still has unscanned files after running background scan, background scan might be stopped prematurely","userAgent":"--","version":"29.0.8.1","data":{"app":"files"}}
{"reqId":"j2EVQYJeaOMQ7dfJBGZQ","level":2,"time":"2024-10-25T11:54:08+00:00","remoteAddr":"192.168.100.62","user":"admin","app":"user_ldap","method":"POST","url":"/apps/user_ldap/ajax/getConfiguration.php","message":"Configuration Error (prefix s01): No LDAP Host given!","userAgent":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:131.0) Gecko/20100101 Firefox/131.0","version":"29.0.8.1","data":{"app":"user_ldap"}}
{"reqId":"j2EVQYJeaOMQ7dfJBGZQ","level":2,"time":"2024-10-25T11:54:08+00:00","remoteAddr":"192.168.100.62","user":"admin","app":"user_ldap","method":"POST","url":"/apps/user_ldap/ajax/getConfiguration.php","message":"Configuration Error (prefix s01): No LDAP Login Filter given!","userAgent":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:131.0) Gecko/20100101 Firefox/131.0","version":"29.0.8.1","data":{"app":"user_ldap"}}
{"reqId":"j2EVQYJeaOMQ7dfJBGZQ","level":2,"time":"2024-10-25T11:54:08+00:00","remoteAddr":"192.168.100.62","user":"admin","app":"user_ldap","method":"POST","url":"/apps/user_ldap/ajax/getConfiguration.php","message":"Configuration Error (prefix s01): No LDAP Port given!","userAgent":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:131.0) Gecko/20100101 Firefox/131.0","version":"29.0.8.1","data":{"app":"user_ldap"}}
{"reqId":"j2EVQYJeaOMQ7dfJBGZQ","level":2,"time":"2024-10-25T11:54:08+00:00","remoteAddr":"192.168.100.62","user":"admin","app":"user_ldap","method":"POST","url":"/apps/user_ldap/ajax/getConfiguration.php","message":"Configuration Error (prefix s01): Not a single Base DN given.","userAgent":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:131.0) Gecko/20100101 Firefox/131.0","version":"29.0.8.1","data":{"app":"user_ldap"}}
{"reqId":"j2EVQYJeaOMQ7dfJBGZQ","level":2,"time":"2024-10-25T11:54:08+00:00","remoteAddr":"192.168.100.62","user":"admin","app":"user_ldap","method":"POST","url":"/apps/user_ldap/ajax/getConfiguration.php","message":"Configuration Error (prefix s01): login filter does not contain %uid place holder.","userAgent":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:131.0) Gecko/20100101 Firefox/131.0","version":"29.0.8.1","data":{"app":"user_ldap"}}
{"reqId":"dw459WQpvtEqONKZVOWt","level":2,"time":"2024-10-25T11:55:08+00:00","remoteAddr":"","user":"--","app":"files","method":"","url":"--","message":"User ***REMOVED SENSITIVE VALUE*** still has unscanned files after running background scan, background scan might be stopped prematurely","userAgent":"--","version":"29.0.8.1","data":{"app":"files"}}
{"reqId":"Snre9uZGeJqOqKJKarkr","level":3,"time":"2024-10-25T12:03:23+00:00","remoteAddr":"192.168.100.62","user":"--","app":"no app in context","method":"OPTIONS","url":"/remote.php/dav/files/admin/Neupr%C3%A4sentation%20***REMOVED SENSITIVE VALUE***/Planung/LPH%203%20-%20Entwurf/","message":"Could not decrypt or decode encrypted session data","userAgent":"WebDAVFS/3.0.0 (03008000) Darwin/24.0.0 (arm64)","version":"29.0.8.1","exception":{"Exception":"Exception","Message":"HMAC does not match.","Code":0,"Trace":[{"file":"/var/www/nextcloud/lib/private/Security/Crypto.php","line":119,"function":"decryptWithoutSecret","class":"OC\\Security\\Crypto","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/nextcloud/lib/private/Session/CryptoSessionData.php","line":91,"function":"decrypt","class":"OC\\Security\\Crypto","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/nextcloud/lib/private/Session/CryptoSessionData.php","line":68,"function":"initializeSession","class":"OC\\Session\\CryptoSessionData","type":"->"},{"file":"/var/www/nextcloud/lib/private/Session/CryptoWrapper.php","line":112,"function":"__construct","class":"OC\\Session\\CryptoSessionData","type":"->"},{"file":"/var/www/nextcloud/lib/base.php","line":463,"function":"wrapSession","class":"OC\\Session\\CryptoWrapper","type":"->"},{"file":"/var/www/nextcloud/lib/base.php","line":719,"function":"initSession","class":"OC","type":"::"},{"file":"/var/www/nextcloud/lib/base.php","line":1189,"function":"init","class":"OC","type":"::"},{"file":"/var/www/nextcloud/remote.php","line":119,"args":["/var/www/nextcloud/lib/base.php"],"function":"require_once"}],"File":"/var/www/nextcloud/lib/private/Security/Crypto.php","Line":158,"message":"Could not decrypt or decode encrypted session data","exception":{},"CustomMessage":"Could not decrypt or decode encrypted session data"}}
{"reqId":"yqlutkf2RTnBH3EPJ2Sb","level":3,"time":"2024-10-25T12:09:48+00:00","remoteAddr":"192.168.100.62","user":"--","app":"no app in context","method":"OPTIONS","url":"/remote.php/dav/files/admin/","message":"Could not decrypt or decode encrypted session data","userAgent":"WebDAVFS/3.0.0 (03008000) Darwin/24.0.0 (arm64)","version":"29.0.8.1","exception":{"Exception":"Exception","Message":"HMAC does not match.","Code":0,"Trace":[{"file":"/var/www/nextcloud/lib/private/Security/Crypto.php","line":119,"function":"decryptWithoutSecret","class":"OC\\Security\\Crypto","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/nextcloud/lib/private/Session/CryptoSessionData.php","line":91,"function":"decrypt","class":"OC\\Security\\Crypto","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/nextcloud/lib/private/Session/CryptoSessionData.php","line":68,"function":"initializeSession","class":"OC\\Session\\CryptoSessionData","type":"->"},{"file":"/var/www/nextcloud/lib/private/Session/CryptoWrapper.php","line":112,"function":"__construct","class":"OC\\Session\\CryptoSessionData","type":"->"},{"file":"/var/www/nextcloud/lib/base.php","line":463,"function":"wrapSession","class":"OC\\Session\\CryptoWrapper","type":"->"},{"file":"/var/www/nextcloud/lib/base.php","line":719,"function":"initSession","class":"OC","type":"::"},{"file":"/var/www/nextcloud/lib/base.php","line":1189,"function":"init","class":"OC","type":"::"},{"file":"/var/www/nextcloud/remote.php","line":119,"args":["/var/www/nextcloud/lib/base.php"],"function":"require_once"}],"File":"/var/www/nextcloud/lib/private/Security/Crypto.php","Line":158,"message":"Could not decrypt or decode encrypted session data","exception":{},"CustomMessage":"Could not decrypt or decode encrypted session data"}}
{"reqId":"M4iDWRNHjmQOt8e7Jk00","level":2,"time":"2024-10-25T12:10:04+00:00","remoteAddr":"","user":"--","app":"files","method":"","url":"--","message":"User ***REMOVED SENSITIVE VALUE*** still has unscanned files after running background scan, background scan might be stopped prematurely","userAgent":"--","version":"29.0.8.1","data":{"app":"files"}}
{"reqId":"nSCTKU7D2icdWd6rKpMP","level":3,"time":"2024-10-25T12:14:40+00:00","remoteAddr":"192.168.100.62","user":"--","app":"no app in context","method":"OPTIONS","url":"/remote.php/dav/groupfolders/admin/","message":"Could not decrypt or decode encrypted session data","userAgent":"WebDAVFS/3.0.0 (03008000) Darwin/24.0.0 (arm64)","version":"29.0.8.1","exception":{"Exception":"Exception","Message":"HMAC does not match.","Code":0,"Trace":[{"file":"/var/www/nextcloud/lib/private/Security/Crypto.php","line":119,"function":"decryptWithoutSecret","class":"OC\\Security\\Crypto","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/nextcloud/lib/private/Session/CryptoSessionData.php","line":91,"function":"decrypt","class":"OC\\Security\\Crypto","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/nextcloud/lib/private/Session/CryptoSessionData.php","line":68,"function":"initializeSession","class":"OC\\Session\\CryptoSessionData","type":"->"},{"file":"/var/www/nextcloud/lib/private/Session/CryptoWrapper.php","line":112,"function":"__construct","class":"OC\\Session\\CryptoSessionData","type":"->"},{"file":"/var/www/nextcloud/lib/base.php","line":463,"function":"wrapSession","class":"OC\\Session\\CryptoWrapper","type":"->"},{"file":"/var/www/nextcloud/lib/base.php","line":719,"function":"initSession","class":"OC","type":"::"},{"file":"/var/www/nextcloud/lib/base.php","line":1189,"function":"init","class":"OC","type":"::"},{"file":"/var/www/nextcloud/remote.php","line":119,"args":["/var/www/nextcloud/lib/base.php"],"function":"require_once"}],"File":"/var/www/nextcloud/lib/private/Security/Crypto.php","Line":158,"message":"Could not decrypt or decode encrypted session data","exception":{},"CustomMessage":"Could not decrypt or decode encrypted session data"}}
{"reqId":"2hvmADlhu0dcMFHFjniL","level":3,"time":"2024-10-25T12:24:08+00:00","remoteAddr":"192.168.252.134","user":"--","app":"no app in context","method":"REPORT","url":"/remote.php/dav/files/Podcastkurs","message":"Could not decrypt or decode encrypted session data","userAgent":"Mozilla/5.0 (iOS) Nextcloud-iOS/5.2.7","version":"29.0.8.1","exception":{"Exception":"Exception","Message":"HMAC does not match.","Code":0,"Trace":[{"file":"/var/www/nextcloud/lib/private/Security/Crypto.php","line":119,"function":"decryptWithoutSecret","class":"OC\\Security\\Crypto","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/nextcloud/lib/private/Session/CryptoSessionData.php","line":91,"function":"decrypt","class":"OC\\Security\\Crypto","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/nextcloud/lib/private/Session/CryptoSessionData.php","line":68,"function":"initializeSession","class":"OC\\Session\\CryptoSessionData","type":"->"},{"file":"/var/www/nextcloud/lib/private/Session/CryptoWrapper.php","line":112,"function":"__construct","class":"OC\\Session\\CryptoSessionData","type":"->"},{"file":"/var/www/nextcloud/lib/base.php","line":463,"function":"wrapSession","class":"OC\\Session\\CryptoWrapper","type":"->"},{"file":"/var/www/nextcloud/lib/base.php","line":719,"function":"initSession","class":"OC","type":"::"},{"file":"/var/www/nextcloud/lib/base.php","line":1189,"function":"init","class":"OC","type":"::"},{"file":"/var/www/nextcloud/remote.php","line":119,"args":["/var/www/nextcloud/lib/base.php"],"function":"require_once"}],"File":"/var/www/nextcloud/lib/private/Security/Crypto.php","Line":158,"message":"Could not decrypt or decode encrypted session data","exception":{},"CustomMessage":"Could not decrypt or decode encrypted session data"}}
{"reqId":"95avlwxactyGiM6GUjzn","level":3,"time":"2024-10-25T12:24:08+00:00","remoteAddr":"192.168.252.134","user":"--","app":"no app in context","method":"GET","url":"/index.php/avatar/Podcastkurs/256","message":"Could not decrypt or decode encrypted session data","userAgent":"Mozilla/5.0 (iOS) Nextcloud-iOS/5.2.7","version":"29.0.8.1","exception":{"Exception":"Exception","Message":"HMAC does not match.","Code":0,"Trace":[{"file":"/var/www/nextcloud/lib/private/Security/Crypto.php","line":119,"function":"decryptWithoutSecret","class":"OC\\Security\\Crypto","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/nextcloud/lib/private/Session/CryptoSessionData.php","line":91,"function":"decrypt","class":"OC\\Security\\Crypto","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/nextcloud/lib/private/Session/CryptoSessionData.php","line":68,"function":"initializeSession","class":"OC\\Session\\CryptoSessionData","type":"->"},{"file":"/var/www/nextcloud/lib/private/Session/CryptoWrapper.php","line":112,"function":"__construct","class":"OC\\Session\\CryptoSessionData","type":"->"},{"file":"/var/www/nextcloud/lib/base.php","line":463,"function":"wrapSession","class":"OC\\Session\\CryptoWrapper","type":"->"},{"file":"/var/www/nextcloud/lib/base.php","line":719,"function":"initSession","class":"OC","type":"::"},{"file":"/var/www/nextcloud/lib/base.php","line":1189,"function":"init","class":"OC","type":"::"},{"file":"/var/www/nextcloud/index.php","line":47,"args":["/var/www/nextcloud/lib/base.php"],"function":"require_once"}],"File":"/var/www/nextcloud/lib/private/Security/Crypto.php","Line":158,"message":"Could not decrypt or decode encrypted session data","exception":{},"CustomMessage":"Could not decrypt or decode encrypted session data"}}
{"reqId":"lAIfyqBoCiMx7pljxASn","level":2,"time":"2024-10-25T12:25:05+00:00","remoteAddr":"","user":"--","app":"files","method":"","url":"--","message":"User ***REMOVED SENSITIVE VALUE*** still has unscanned files after running background scan, background scan might be stopped prematurely","userAgent":"--","version":"29.0.8.1","data":{"app":"files"}}
{"reqId":"2ABBRQyrmobw3ckIypky","level":2,"time":"2024-10-25T12:40:05+00:00","remoteAddr":"","user":"--","app":"files","method":"","url":"--","message":"User ***REMOVED SENSITIVE VALUE*** still has unscanned files after running background scan, background scan might be stopped prematurely","userAgent":"--","version":"29.0.8.1","data":{"app":"files"}}
{"reqId":"fAIlW6y9oQJMJCHo20hF","level":3,"time":"2024-10-25T12:43:08+00:00","remoteAddr":"192.168.100.62","user":"--","app":"no app in context","method":"OPTIONS","url":"/remote.php/dav/groupfolders/admin/","message":"Could not decrypt or decode encrypted session data","userAgent":"WebDAVFS/3.0.0 (03008000) Darwin/24.0.0 (arm64)","version":"29.0.8.1","exception":{"Exception":"Exception","Message":"HMAC does not match.","Code":0,"Trace":[{"file":"/var/www/nextcloud/lib/private/Security/Crypto.php","line":119,"function":"decryptWithoutSecret","class":"OC\\Security\\Crypto","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/nextcloud/lib/private/Session/CryptoSessionData.php","line":91,"function":"decrypt","class":"OC\\Security\\Crypto","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/nextcloud/lib/private/Session/CryptoSessionData.php","line":68,"function":"initializeSession","class":"OC\\Session\\CryptoSessionData","type":"->"},{"file":"/var/www/nextcloud/lib/private/Session/CryptoWrapper.php","line":112,"function":"__construct","class":"OC\\Session\\CryptoSessionData","type":"->"},{"file":"/var/www/nextcloud/lib/base.php","line":463,"function":"wrapSession","class":"OC\\Session\\CryptoWrapper","type":"->"},{"file":"/var/www/nextcloud/lib/base.php","line":719,"function":"initSession","class":"OC","type":"::"},{"file":"/var/www/nextcloud/lib/base.php","line":1189,"function":"init","class":"OC","type":"::"},{"file":"/var/www/nextcloud/remote.php","line":119,"args":["/var/www/nextcloud/lib/base.php"],"function":"require_once"}],"File":"/var/www/nextcloud/lib/private/Security/Crypto.php","Line":158,"message":"Could not decrypt or decode encrypted session data","exception":{},"CustomMessage":"Could not decrypt or decode encrypted session data"}}
{"reqId":"Bzsn4ll3hJ5zM1hzPQnh","level":3,"time":"2024-10-25T12:44:08+00:00","remoteAddr":"192.168.100.62","user":"admin","app":"core","method":"GET","url":"/index.php/apps/files/preview-service-worker.js","message":"Renewing session token failed: Token does not exist: token does not exist","userAgent":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:131.0) Gecko/20100101 Firefox/131.0","version":"29.0.8.1","exception":{"Exception":"OC\\Authentication\\Exceptions\\InvalidTokenException","Message":"Token does not exist: token does not exist","Code":0,"Trace":[{"file":"/var/www/nextcloud/lib/private/Authentication/Token/PublicKeyTokenProvider.php","line":254,"function":"getToken","class":"OC\\Authentication\\Token\\PublicKeyTokenProvider","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/nextcloud/lib/public/AppFramework/Db/TTransactional.php","line":63,"function":"OC\\Authentication\\Token\\{closure}","class":"OC\\Authentication\\Token\\PublicKeyTokenProvider","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/nextcloud/lib/private/Authentication/Token/PublicKeyTokenProvider.php","line":283,"function":"atomic","class":"OC\\Authentication\\Token\\PublicKeyTokenProvider","type":"->"},{"file":"/var/www/nextcloud/lib/private/Authentication/Token/Manager.php","line":175,"function":"renewSessionToken","class":"OC\\Authentication\\Token\\PublicKeyTokenProvider","type":"->"},{"file":"/var/www/nextcloud/lib/private/User/Session.php","line":914,"function":"renewSessionToken","class":"OC\\Authentication\\Token\\Manager","type":"->"},{"file":"/var/www/nextcloud/lib/base.php","line":1140,"function":"loginWithCookie","class":"OC\\User\\Session","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/nextcloud/lib/base.php","line":1047,"function":"handleLogin","class":"OC","type":"::"},{"file":"/var/www/nextcloud/index.php","line":49,"function":"handleRequest","class":"OC","type":"::"}],"File":"/var/www/nextcloud/lib/private/Authentication/Token/PublicKeyTokenProvider.php","Line":187,"Previous":{"Exception":"OCP\\AppFramework\\Db\\DoesNotExistException","Message":"token does not exist","Code":0,"Trace":[{"file":"/var/www/nextcloud/lib/private/Authentication/Token/PublicKeyTokenProvider.php","line":179,"function":"getToken","class":"OC\\Authentication\\Token\\PublicKeyTokenMapper","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/nextcloud/lib/private/Authentication/Token/PublicKeyTokenProvider.php","line":254,"function":"getToken","class":"OC\\Authentication\\Token\\PublicKeyTokenProvider","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/nextcloud/lib/public/AppFramework/Db/TTransactional.php","line":63,"function":"OC\\Authentication\\Token\\{closure}","class":"OC\\Authentication\\Token\\PublicKeyTokenProvider","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/nextcloud/lib/private/Authentication/Token/PublicKeyTokenProvider.php","line":283,"function":"atomic","class":"OC\\Authentication\\Token\\PublicKeyTokenProvider","type":"->"},{"file":"/var/www/nextcloud/lib/private/Authentication/Token/Manager.php","line":175,"function":"renewSessionToken","class":"OC\\Authentication\\Token\\PublicKeyTokenProvider","type":"->"},{"file":"/var/www/nextcloud/lib/private/User/Session.php","line":914,"function":"renewSessionToken","class":"OC\\Authentication\\Token\\Manager","type":"->"},{"file":"/var/www/nextcloud/lib/base.php","line":1140,"function":"loginWithCookie","class":"OC\\User\\Session","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/nextcloud/lib/base.php","line":1047,"function":"handleLogin","class":"OC","type":"::"},{"file":"/var/www/nextcloud/index.php","line":49,"function":"handleRequest","class":"OC","type":"::"}],"File":"/var/www/nextcloud/lib/private/Authentication/Token/PublicKeyTokenMapper.php","Line":97},"message":"Renewing session token failed: Token does not exist: token does not exist","user":"admin","exception":{},"CustomMessage":"Renewing session token failed: Token does not exist: token does not exist"}}

Additional info

WebDav
https://github.com/user-attachments/assets/9641003c-40da-4df8-bd61-41bfaa8f5f77

WebGUI (via DAV /remote.php/dav/files/)

[joshtrichards]

Can you provide the output of the following:

curl -I -X PROPFIND --user USERNAME:PASSWORD 'https://domain.tld/remote.php/dav/files/USERNAME/aGroupFolder'

Then:

curl -X PROPFIND --user USERNAME:PASSWORD 'https://domain.tld/remote.php/dav/files/USERNAME/aGroupFolder'

If you install xml_pp you can more easily check the output to see what files/folders are included in output in the second transaction.

See here and here.

We are struggling for already a while with not reliable showing up of files and folders specifically for so called groupfolders.

Any idea when it may have started?

still has unscanned files after running background scan, background scan might be stopped prematurely

For this, try doing a scan of unscanned files from the command line (basically what this background job does) with verbose mode on and seeing what happens (occ files:scan --unscanned -vvv [user])

"Could not decrypt or decode encrypted session data"

Is this occurring a lot in your environment across a wide variety of client types?

[dr-christoph-schneider]

Can you provide the output of the following:

curl -I -X PROPFIND --user USERNAME:PASSWORD 'https://domain.tld/remote.php/dav/files/USERNAME/aGroupFolder'

HTTP/1.1 207 Multi-Status
Date: Fri, 25 Oct 2024 16:35:17 GMT
Server: Apache/2.4.52 (Ubuntu)
Strict-Transport-Security: max-age=15552000; preload
Referrer-Policy: no-referrer
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Permitted-Cross-Domain-Policies: none
X-Robots-Tag: noindex, nofollow
X-XSS-Protection: 1; mode=block
Set-Cookie: oc5gef9ydbjx=edlj5i8n2r1oq3hvpqqn1nu8dp; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: oc_sessionPassphrase=ahnmxmc2vN2ZnRM5LGy6AecSqJWa5xXkLPmk4k%2FyiE%2F8R6udek4d7%2Bl5Eve1ULuaA5A46HbCg5p22RUQlpYr9w3LXxTLybLH%2FCP2DZ8wkeFBWDkQb3jNcFmiFIRHrFcZ; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: oc5gef9ydbjx=edlj5i8n2r1oq3hvpqqn1nu8dp; path=/; secure; HttpOnly; SameSite=Lax
Content-Security-Policy: default-src 'none';
Set-Cookie: __Host-nc_sameSiteCookielax=true; path=/; httponly;secure; expires=Fri, 31-Dec-2100 23:59:59 GMT; SameSite=lax
Set-Cookie: __Host-nc_sameSiteCookiestrict=true; path=/; httponly;secure; expires=Fri, 31-Dec-2100 23:59:59 GMT; SameSite=strict
Set-Cookie: oc5gef9ydbjx=edlj5i8n2r1oq3hvpqqn1nu8dp; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: oc5gef9ydbjx=edlj5i8n2r1oq3hvpqqn1nu8dp; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: oc5gef9ydbjx=8feag3k4cadckufgl90hrup81t; path=/; secure; HttpOnly; SameSite=Lax
Set-Cookie: cookie_test=test; expires=Fri, 25-Oct-2024 17:35:18 GMT; Max-Age=3600
Vary: Brief,Prefer
DAV: 1, 3, extended-mkcol, access-control, calendarserver-principal-property-search, nextcloud-checksum-update, nc-calendar-search, nc-enable-birthday-calendar
X-Request-Id: Q7eSvEb5lwsIlIe3aOQi
X-Debug-Token: Q7eSvEb5lwsIlIe3aOQi
Content-Length: 1657
Content-Type: application/xml; charset=utf-8

Then:

curl -X PROPFIND --user USERNAME:PASSWORD 'https://domain.tld/remote.php/dav/files/USERNAME/aGroupFolder'

If i call this
curl -X PROPFIND --user admin:***REMOVED SENSITIVE VALUE*** 'https://cloud.***REMOVED SENSITIVE VALUE***.de/remote.php/dav/files/admin/Neupr%C3%A4sentation%XXXXXX/Planung/LPH%203%20-%20Entwurf/'| xmllint --format -

I get randomly either this for the result of missing files/folders

% Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  1657  100  1657    0     0   1581      0  0:00:01  0:00:01 --:--:--  1582
<?xml version="1.0"?>
<d:multistatus xmlns:d="DAV:" xmlns:s="http://sabredav.org/ns" xmlns:oc="http://owncloud.org/ns" xmlns:nc="http://nextcloud.org/ns">
  <d:response>
    <d:href>/remote.php/dav/files/admin/Neupr%c3%a4sentation%20XXXXXX/Planung/LPH%203%20-%20Entwurf/</d:href>
    <d:propstat>
      <d:prop>
        <d:getlastmodified>Thu, 24 Oct 2024 16:14:43 GMT</d:getlastmodified>
        <d:resourcetype>
          <d:collection/>
        </d:resourcetype>
        <d:quota-used-bytes>178348499</d:quota-used-bytes>
        <d:quota-available-bytes>8815036556</d:quota-available-bytes>
        <d:getetag>"671a727333e6d"</d:getetag>
      </d:prop>
      <d:status>HTTP/1.1 200 OK</d:status>
    </d:propstat>
  </d:response>
  <d:response>
    <d:href>/remote.php/dav/files/admin/Neupr%c3%a4sentation%20XXXXXX/Planung/LPH%203%20-%20Entwurf/Erdgeschoss/</d:href>
    <d:propstat>
      <d:prop>
        <d:getlastmodified>Wed, 26 Jun 2024 15:09:45 GMT</d:getlastmodified>
        <d:resourcetype>
          <d:collection/>
        </d:resourcetype>
        <d:quota-used-bytes>0</d:quota-used-bytes>
        <d:quota-available-bytes>8815036556</d:quota-available-bytes>
        <d:getetag>"66acb2d927e16"</d:getetag>
      </d:prop>
      <d:status>HTTP/1.1 200 OK</d:status>
    </d:propstat>
  </d:response>
  <d:response>
    <d:href>/remote.php/dav/files/admin/Neupr%c3%a4sentation%20XXXXXX/Planung/LPH%203%20-%20Entwurf/Stadtgeschoss/</d:href>
    <d:propstat>
      <d:prop>
        <d:getlastmodified>Wed, 26 Jun 2024 15:10:04 GMT</d:getlastmodified>
        <d:resourcetype>
          <d:collection/>
        </d:resourcetype>
        <d:quota-used-bytes>0</d:quota-used-bytes>
        <d:quota-available-bytes>8815036556</d:quota-available-bytes>
        <d:getetag>"66acb2d927e2c"</d:getetag>
      </d:prop>
      <d:status>HTTP/1.1 200 OK</d:status>
    </d:propstat>
  </d:response>
</d:multistatus>

or that for the result of a complete response containing all current files/folders from the data directory

% Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  3164  100  3164    0     0   2795      0  0:00:01  0:00:01 --:--:--  2797
<?xml version="1.0"?>
<d:multistatus xmlns:d="DAV:" xmlns:s="http://sabredav.org/ns" xmlns:oc="http://owncloud.org/ns" xmlns:nc="http://nextcloud.org/ns">
  <d:response>
    <d:href>/remote.php/dav/files/admin/Neupr%c3%a4sentation%XXXXXX/Planung/LPH%203%20-%20Entwurf/</d:href>
    <d:propstat>
      <d:prop>
        <d:getlastmodified>Thu, 24 Oct 2024 16:14:43 GMT</d:getlastmodified>
        <d:resourcetype>
          <d:collection/>
        </d:resourcetype>
        <d:quota-used-bytes>178348499</d:quota-used-bytes>
        <d:quota-available-bytes>8815036556</d:quota-available-bytes>
        <d:getetag>"671a72734b915"</d:getetag>
      </d:prop>
      <d:status>HTTP/1.1 200 OK</d:status>
    </d:propstat>
  </d:response>
  <d:response>
    <d:href>/remote.php/dav/files/admin/Neupr%c3%a4sentation%XXXXXX/Planung/LPH%203%20-%20Entwurf/1.%20Obergeschoss/</d:href>
    <d:propstat>
      <d:prop>
        <d:getlastmodified>Wed, 26 Jun 2024 15:10:12 GMT</d:getlastmodified>
        <d:resourcetype>
          <d:collection/>
        </d:resourcetype>
        <d:quota-used-bytes>0</d:quota-used-bytes>
        <d:quota-available-bytes>8815036556</d:quota-available-bytes>
        <d:getetag>"66b3a81da3e05"</d:getetag>
      </d:prop>
      <d:status>HTTP/1.1 200 OK</d:status>
    </d:propstat>
  </d:response>
  <d:response>
    <d:href>/remote.php/dav/files/admin/Neupr%c3%a4sentation%XXXXXX/Planung/LPH%203%20-%20Entwurf/2.%20Obergeschoss/</d:href>
    <d:propstat>
      <d:prop>
        <d:getlastmodified>Thu, 24 Oct 2024 16:14:43 GMT</d:getlastmodified>
        <d:resourcetype>
          <d:collection/>
        </d:resourcetype>
        <d:quota-used-bytes>178325059</d:quota-used-bytes>
        <d:quota-available-bytes>8815036556</d:quota-available-bytes>
        <d:getetag>"671a727333e6d"</d:getetag>
      </d:prop>
      <d:status>HTTP/1.1 200 OK</d:status>
    </d:propstat>
  </d:response>
  <d:response>
    <d:href>/remote.php/dav/files/admin/Neupr%c3%a4sentation%XXXXXX/Planung/LPH%203%20-%20Entwurf/Erdgeschoss/</d:href>
    <d:propstat>
      <d:prop>
        <d:getlastmodified>Wed, 26 Jun 2024 15:09:45 GMT</d:getlastmodified>
        <d:resourcetype>
          <d:collection/>
        </d:resourcetype>
        <d:quota-used-bytes>0</d:quota-used-bytes>
        <d:quota-available-bytes>8815036556</d:quota-available-bytes>
        <d:getetag>"66b3a81da3e33"</d:getetag>
      </d:prop>
      <d:status>HTTP/1.1 200 OK</d:status>
    </d:propstat>
  </d:response>
  <d:response>
    <d:href>/remote.php/dav/files/admin/Neupr%c3%a4sentation%XXXXXX/Planung/LPH%203%20-%20Entwurf/LM2026_Inhalte%20LPH%203.pdf</d:href>
    <d:propstat>
      <d:prop>
        <d:getlastmodified>Tue, 22 Oct 2024 10:48:53 GMT</d:getlastmodified>
        <d:getcontentlength>23440</d:getcontentlength>
        <d:resourcetype/>
        <d:getetag>"98e15852f3e31a84c4a023582790ce6d"</d:getetag>
        <d:getcontenttype>application/pdf</d:getcontenttype>
      </d:prop>
      <d:status>HTTP/1.1 200 OK</d:status>
    </d:propstat>
  </d:response>
  <d:response>
    <d:href>/remote.php/dav/files/admin/Neupr%c3%a4sentation%XXXXXX/Planung/LPH%203%20-%20Entwurf/Stadtgeschoss/</d:href>
    <d:propstat>
      <d:prop>
        <d:getlastmodified>Wed, 26 Jun 2024 15:10:04 GMT</d:getlastmodified>
        <d:resourcetype>
          <d:collection/>
        </d:resourcetype>
        <d:quota-used-bytes>0</d:quota-used-bytes>
        <d:quota-available-bytes>8815036556</d:quota-available-bytes>
        <d:getetag>"66b3a81da3e47"</d:getetag>
      </d:prop>
      <d:status>HTTP/1.1 200 OK</d:status>
    </d:propstat>
  </d:response>
</d:multistatus>

So not very surprisingly it shows the same buggy picture as with the WebGUI (or WebDAV)!

To me this looks like the dav-files-fetching is erroneously giving different files/folder-setups due to an errorprone underlying-mechanism within maybe the oc_filecache.

Or what could be the reason for randomly getting varying responses everytime you call the same request?

Is it due to different temporal versions of that (sub)directory (e.g. version of last week vs. today) or due to a "nondetermistic interpretation" of the request by e.g. loosing user permissions while still executing the request or a runtime issue not waiting long enough for the file/folder-collector till having completed .... or what?

We are struggling for already a while with not reliable showing up of files and folders specifically for so called groupfolders.

Any idea when it may have started?

Since using groupfolders and on top the app openproject_integration.

still has unscanned files after running background scan, background scan might be stopped prematurely

For this, try doing a scan of unscanned files from the command line (basically what this background job does) with verbose mode on and seeing what happens (occ files:scan --unscanned -vvv [user])

Did that, but for whatever reason it gives

Starting scan for user 1 out of 1 ([user])

+---------+-------+-----+---------+---------+--------+--------------+
| Folders | Files | New | Updated | Removed | Errors | Elapsed time |
+---------+-------+-----+---------+---------+--------+--------------+
| 0       | 0     | 0   | 0       | 0       | 0      | 00:00:01     |
+---------+-------+-----+---------+---------+--------+--------------+

and the log entry remains and shows up again and again - I don't understand why.

"Could not decrypt or decode encrypted session data"

Is this occurring a lot in your environment across a wide variety of client types?

How can I check this? With
sudo grep -c "Could not decrypt or decode encrypted session data" /var/www/nextcloud-data/nextcloud.log
the output of todays log with around 15 different clients all over the day gives: '7'

[SystemKeeper]

Can you try to set debug.force-full-fs-setup to true in the config and retry the test?

[dr-christoph-schneider]

Can you try to set debug.force-full-fs-setup to true in the config and retry the test?

How to do that?

Set in

/var/wwww/nextcloud/config/config.php

the following

...
  'debug' => false,
  'debug.force-full-fs-setup' => true,
 ...

????

And which specific test should I retry?

[dr-christoph-schneider]

To add something new: I also get very buggy randomly varying responses for showing off the Trashbin. Seems like it shows different versions in time....

[SystemKeeper]

How to do that?

Seems okay what you did. Alternatively you can do it via occ config:system:set 'debug.force-full-fs-setup' --type boolean --value true.

And which specific test should I retry?

See if the issue is still reproducible, e.g. in web or via the curl commands.

[dr-christoph-schneider]

config:system:set 'debug.force-full-fs-setup' --type boolean --value true

How to do that?

Seems okay what you did. Alternatively you can do it via occ config:system:set 'debug.force-full-fs-setup' --type boolean --value true.

And which specific test should I retry?

See if the issue is still reproducible, e.g. in web or via the curl commands.

Nothing new with
'debug.force-full-fs-setup' => true,
all errors are still there and the logs still show the same output as before.

[dr-christoph-schneider]

I would like to reset the oc-filecache but without loosing the shared-links - is there any command for doing so?