[Bug]: Client runs out of RAM (Firefox 111.0) (Grid View) #37395

beryl03 · 2023-03-24T18:20:00Z

⚠️ This issue respects the following points: ⚠️

This is a bug, not a question or a configuration/webserver/proxy issue.
This issue is not already reported on Github (I've searched it).
Nextcloud Server is up to date. See Maintenance and Release Schedule for supported versions.
Nextcloud Server is running on 64bit capable CPU, PHP and OS.
I agree to follow Nextcloud's Code of Conduct.

Bug description

When uploading files to Nextcloud from a client (Windows 11, Firefox 111.0, Grid View of Files Tab (app?)), Client ran out of memory. Client RAM utilization slowly increased when uploading hundreds of photos until it ran out of memory at 24 GB consumed.
Repeated 4 times and same behaviour (BAD).
Repeated on List view and client did not increase on memory usage (like grid view did).

Steps to reproduce

1.Set to Grid View
2.Upload 500 photos
3.Watch RAM utilization go up.

Expected behavior

Client should not run out of RAM, or it's image cache (suspect) is to large and it is not evicting.

Installation method

Community Docker image

Operating system

Debian/Ubuntu

PHP engine version

PHP 8.1

Web server

Apache (supported)

Database engine version

MariaDB

Is this bug present after an update or on a fresh install?

Updated to a major version (ex. 22.2.3 to 23.0.1)

Are you using the Nextcloud Server Encryption module?

Encryption is Disabled

What user-backends are you using?

Default user-backend (database)
LDAP/ Active Directory
SSO - SAML
Other

Configuration report

{
    "system": {
        "htaccess.RewriteBase": "\/",
        "apps_paths": [
            {
                "path": "\/var\/www\/html\/apps",
                "url": "\/apps",
                "writable": false
            },
            {
                "path": "\/var\/www\/html\/custom_apps",
                "url": "\/custom_apps",
                "writable": true
            }
        ],
        "instanceid": "***REMOVED SENSITIVE VALUE***",
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": [
            "***REMOVED SENSITIVE VALUE***"
        ],
        "trusted_proxies ": [
            "***REMOVED SENSITIVE VALUE***",
            "***REMOVED SENSITIVE VALUE***"
        ],
        "forwarded_for_headers": [
            "HTTP_X_FORWARDED",
            "HTTP_FORWARDED_FOR"
        ],
        "overwritehost": "***REMOVED SENSITIVE VALUE***",
        "overwriteprotocol": "https",
        "overwritewebroot": "\/",
        "default_phone_region": "US",
        "datadirectory": "***REMOVED SENSITIVE VALUE***",
        "dbtype": "mysql",
        "version": "26.0.0.11",
        "overwrite.cli.url": "***REMOVED SENSITIVE VALUE***",
        "dbname": "***REMOVED SENSITIVE VALUE***",
        "dbhost": "***REMOVED SENSITIVE VALUE***",
        "dbport": "3306",
        "dbtableprefix": "oc_",
        "mysql.utf8mb4": true,
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "installed": true,
        "auth.bruteforce.protection.enabled": true,
        "mail_smtpmode": "smtp",
        "mail_smtpsecure": "tls",
        "mail_sendmailmode": "smtp",
        "mail_from_address": "***REMOVED SENSITIVE VALUE***",
        "mail_domain": "***REMOVED SENSITIVE VALUE***",
        "mail_smtpauthtype": "LOGIN",
        "mail_smtpauth": 1,
        "mail_smtphost": "***REMOVED SENSITIVE VALUE***",
        "mail_smtpport": "587",
        "mail_smtpname": "***REMOVED SENSITIVE VALUE***",
        "mail_smtppassword": "***REMOVED SENSITIVE VALUE***",
        "maintenance": false,
        "theme": "",
        "loglevel": 2,
        "memcache.distributed": "\\OC\\Memcache\\Redis",
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "redis": {
            "host": "***REMOVED SENSITIVE VALUE***",
            "password": "***REMOVED SENSITIVE VALUE***",
            "port": 6379
        },
        "trusted_proxies": "***REMOVED SENSITIVE VALUE***",
        "app_install_overwrite": [
            "contacts"
        ],
        "memcache.local": "\\OC\\Memcache\\APCu",
        "memories.exiftool": "\/var\/www\/html\/custom_apps\/memories\/exiftool-bin\/exiftool-amd64-glibc"
    }
}

List of activated Apps

Enabled:
  - activity: 2.18.0
  - bruteforcesettings: 2.6.0
  - calendar: 4.3.1
  - circles: 26.0.0
  - cloud_federation_api: 1.9.0
  - comments: 1.16.0
  - contacts: 5.2.0
  - contactsinteraction: 1.7.0
  - dashboard: 7.6.0
  - dav: 1.25.0
  - deck: 1.9.0
  - federatedfilesharing: 1.16.0
  - federation: 1.16.0
  - files: 1.21.1
  - files_automatedtagging: 1.16.1
  - files_pdfviewer: 2.7.0
  - files_rightclick: 1.5.0
  - files_sharing: 1.18.0
  - files_trashbin: 1.16.0
  - files_versions: 1.19.1
  - firstrunwizard: 2.15.0
  - logreader: 2.11.0
  - lookup_server_connector: 1.14.0
  - nextcloud_announcements: 1.15.0
  - notes: 4.7.2
  - notifications: 2.14.0
  - oauth2: 1.14.0
  - onlyoffice: 7.8.0
  - password_policy: 1.16.0
  - photos: 2.2.0
  - privacy: 1.10.0
  - provisioning_api: 1.16.0
  - recommendations: 1.5.0
  - related_resources: 1.1.0-alpha1
  - serverinfo: 1.16.0
  - settings: 1.8.0
  - sharebymail: 1.16.0
  - support: 1.9.0
  - survey_client: 1.14.0
  - systemtags: 1.16.0
  - tasks: 0.14.5
  - text: 3.7.2
  - theming: 2.1.1
  - twofactor_backupcodes: 1.15.0
  - updatenotification: 1.16.0
  - user_status: 1.6.0
  - viewer: 1.10.0
  - weather_status: 1.6.0
  - workflow_script: 1.11.1
  - workflowengine: 2.8.0
Disabled:
  - admin_audit: 1.16.0
  - carnet: 0.24.6 (installed 0.24.6)
  - encryption: 2.14.0
  - files_external: 1.18.0
  - memories: 4.12.3 (installed 4.12.3)
  - quota_warning: 1.15.0 (installed 1.15.0)
  - richdocumentscode: 22.5.802 (installed 22.5.802)
  - suspicious_login: 4.4.0 (installed 4.3.0)
  - twofactor_totp: 8.0.0-alpha.0
  - user_ldap: 1.16.0
  - workflow_media_converter: 1.7.0 (installed 1.7.0)

Nextcloud Signing status

No errors have been found.

Nextcloud Logs

Undefined array key "mail_smtpauthtype" at /var/www/html/apps/settings/templates/settings/admin/additional-mail.php#132	
2023-03-24T13:05:48-0500
Error	core	OC\DB\Exceptions\DbalException: An exception occurred while executing a query: SQLSTATE[42S02]: Base table or view not found: 1146 Table 'nextcloud.oc_open_local_editor' doesn't exist	
2023-03-24T08:10:02-0500
Error	core	OC\DB\Exceptions\DbalException: An exception occurred while executing a query: SQLSTATE[42S02]: Base table or view not found: 1146 Table 'nextcloud.oc_open_local_editor' doesn't exist	
2023-03-23T20:10:01-0500
Error	no app in context	Exception: App "Automated media conversion" cannot be installed because it is not compatible with this version of the server.	
2023-03-23T11:51:53-0500
Error	no app in context	Exception: App "Quota warning" cannot be installed because it is not compatible with this version of the server.	
2023-03-23T11:51:53-0500
Error	no app in context	Exception: App "Memories" cannot be installed because it is not compatible with this version of the server.	
2023-03-23T11:51:53-0500
Error	no app in context	Exception: App "Carnet" cannot be installed because it is not compatible with this version of the server.	
2023-03-23T11:51:50-0500
Error	core	OC\DB\Exceptions\DbalException: An exception occurred while executing a query: SQLSTATE[42S02]: Base table or view not found: 1146 Table 'nextcloud.oc_open_local_editor' doesn't exist	
2023-03-23T08:05:02-0500
Error	core	OC\DB\Exceptions\DbalException: An exception occurred while executing a query: SQLSTATE[42S02]: Base table or view not found: 1146 Table 'nextcloud.oc_open_local_editor' doesn't exist	
2023-03-22T20:05:01-0500
Error	core	OC\DB\Exceptions\DbalException: An exception occurred while executing a query: SQLSTATE[42S02]: Base table or view not found: 1146 Table 'nextcloud.oc_open_local_editor' doesn't exist	
2023-03-22T08:00:02-0500
Error	core	OC\DB\Exceptions\DbalException: An exception occurred while executing a query: SQLSTATE[42S02]: Base table or view not found: 1146 Table 'nextcloud.oc_open_local_editor' doesn't exist	
2023-03-21T19:55:01-0500
Error	core	OC\DB\Exceptions\DbalException: An exception occurred while executing a query: SQLSTATE[42S02]: Base table or view not found: 1146 Table 'nextcloud.oc_open_local_editor' doesn't exist	
2023-03-21T07:50:14-0500
Error	core	OC\DB\Exceptions\DbalException: An exception occurred while executing a query: SQLSTATE[42S02]: Base table or view not found: 1146 Table 'nextcloud.oc_open_local_editor' doesn't exist	
2023-03-20T19:50:01-0500
Error	webdav	Doctrine\DBAL\Exception\DeadlockException: An exception occurred while executing a query: SQLSTATE[40001]: Serialization failure: 1213 Deadlock found when trying to get lock; try restarting transaction	
2023-03-20T18:26:29-0500
Error	webdav	Doctrine\DBAL\Exception\DeadlockException: An exception occurred while executing a query: SQLSTATE[40001]: Serialization failure: 1213 Deadlock found when trying to get lock; try restarting transaction	
2023-03-20T18:26:29-0500
Error	webdav	Doctrine\DBAL\Exception\DeadlockException: An exception occurred while executing a query: SQLSTATE[40001]: Serialization failure: 1213 Deadlock found when trying to get lock; try restarting transaction	
2023-03-20T18:15:28-0500
Error	webdav	Doctrine\DBAL\Exception\DeadlockException: An exception occurred while executing a query: SQLSTATE[40001]: Serialization failure: 1213 Deadlock found when trying to get lock; try restarting transaction	
2023-03-20T17:35:07-0500
Error	webdav	Doctrine\DBAL\Exception\DeadlockException: An exception occurred while executing a query: SQLSTATE[40001]: Serialization failure: 1213 Deadlock found when trying to get lock; try restarting transaction	
2023-03-20T17:29:44-0500
Error	webdav	Doctrine\DBAL\Exception\DeadlockException: An exception occurred while executing a query: SQLSTATE[40001]: Serialization failure: 1213 Deadlock found when trying to get lock; try restarting transaction	
2023-03-20T17:16:53-0500
Error	no app in context	OC\DB\Exceptions\DbalException: An exception occurred while executing a query: SQLSTATE[42S02]: Base table or view not found: 1146 Table 'nextcloud.oc_open_local_editor' doesn't exist	
2023-03-20T16:34:52-0500
Error	webdav	Doctrine\DBAL\Exception\DeadlockException: An exception occurred while executing a query: SQLSTATE[40001]: Serialization failure: 1213 Deadlock found when trying to get lock; try restarting transaction	
2023-03-20T16:24:41-0500
Error	webdav	Doctrine\DBAL\Exception\DeadlockException: An exception occurred while executing a query: SQLSTATE[40001]: Serialization failure: 1213 Deadlock found when trying to get lock; try restarting transaction	
2023-03-20T16:24:41-0500
Error	onlyoffice	Exception: Error occurred in the document service: Invalid token	
2023-03-20T15:58:21-0500
Error	onlyoffice	Exception: Error occurred in the document service: Invalid token	
2023-03-20T15:58:21-0500
Error	webdav	Doctrine\DBAL\Exception\DeadlockException: An exception occurred while executing a query: SQLSTATE[40001]: Serialization failure: 1213 Deadlock found when trying to get lock; try restarting transaction	
2023-03-20T15:16:23-0500
Error	webdav	Doctrine\DBAL\Exception\DeadlockException: An exception occurred while executing a query: SQLSTATE[40001]: Serialization failure: 1213 Deadlock found when trying to get lock; try restarting transaction	
2023-03-20T15:16:23-0500
Error	webdav	Doctrine\DBAL\Exception\DeadlockException: An exception occurred while executing a query: SQLSTATE[40001]: Serialization failure: 1213 Deadlock found when trying to get lock; try restarting transaction	
2023-03-20T15:09:34-0500
Error	webdav	Doctrine\DBAL\Exception\DeadlockException: An exception occurred while executing a query: SQLSTATE[40001]: Serialization failure: 1213 Deadlock found when trying to get lock; try restarting transaction	
2023-03-20T13:21:38-0500
Error	core	OC\DB\Exceptions\DbalException: An exception occurred while executing a query: SQLSTATE[42S02]: Base table or view not found: 1146 Table 'nextcloud.oc_open_local_editor' doesn't exist	
2023-03-20T07:45:01-0500
Error	core	OC\DB\Exceptions\DbalException: An exception occurred while executing a query: SQLSTATE[42S02]: Base table or view not found: 1146 Table 'nextcloud.oc_open_local_editor' doesn't exist	
2023-03-19T19:40:03-0500
Error	core	OC\DB\Exceptions\DbalException: An exception occurred while executing a query: SQLSTATE[42S02]: Base table or view not found: 1146 Table 'nextcloud.oc_open_local_editor' doesn't exist	
2023-03-19T07:35:18-0500
Error	core	OC\DB\Exceptions\DbalException: An exception occurred while executing a query: SQLSTATE[42S02]: Base table or view not found: 1146 Table 'nextcloud.oc_open_local_editor' doesn't exist	
2023-03-18T19:30:14-0500
Error	core	OC\DB\Exceptions\DbalException: An exception occurred while executing a query: SQLSTATE[42S02]: Base table or view not found: 1146 Table 'nextcloud.oc_open_local_editor' doesn't exist	
2023-03-18T07:25:17-0500
Error	core	OC\DB\Exceptions\DbalException: An exception occurred while executing a query: SQLSTATE[42S02]: Base table or view not found: 1146 Table 'nextcloud.oc_open_local_editor' doesn't exist	
2023-03-17T19:20:28-0500
Warning	suspicious_login	Could not predict suspiciousness: No models found	
2023-03-17T12:01:58-0500
Warning	suspicious_login	Could not predict suspiciousness: No models found	
2023-03-17T11:46:27-0500
Error	webdav	Doctrine\DBAL\Exception\DeadlockException: An exception occurred while executing a query: SQLSTATE[40001]: Serialization failure: 1213 Deadlock found when trying to get lock; try restarting transaction	
2023-03-17T11:32:21-0500
Error	webdav	Doctrine\DBAL\Exception\DeadlockException: An exception occurred while executing a query: SQLSTATE[40001]: Serialization failure: 1213 Deadlock found when trying to get lock; try restarting transaction	
2023-03-17T11:32:21-0500
Warning	suspicious_login	Could not predict suspiciousness: No models found	
2023-03-17T11:12:56-0500
Warning	suspicious_login	Could not predict suspiciousness: No models found	
2023-03-17T09:49:13-0500
Warning	suspicious_login	Could not predict suspiciousness: No models found	
2023-03-17T09:49:12-0500
Error	webdav	Doctrine\DBAL\Exception\DeadlockException: An exception occurred while executing a query: SQLSTATE[40001]: Serialization failure: 1213 Deadlock found when trying to get lock; try restarting transaction	
2023-03-17T09:07:11-0500
Warning	suspicious_login	Could not predict suspiciousness: No models found	
2023-03-17T09:03:49-0500
Warning	suspicious_login	Could not predict suspiciousness: No models found	
2023-03-17T09:03:49-0500
Warning	suspicious_login	Could not predict suspiciousness: No models found	
2023-03-17T09:02:37-0500
Warning	suspicious_login	Could not predict suspiciousness: No models found	
2023-03-17T09:02:34-0500
Warning	suspicious_login	Could not predict suspiciousness: No models found	
2023-03-17T09:02:33-0500
Warning	suspicious_login	Could not predict suspiciousness: No models found	
2023-03-17T08:15:17-0500
Warning	suspicious_login	Could not predict suspiciousness: No models found	
2023-03-17T08:15:11-0500
Warning	suspicious_login	Could not predict suspiciousness: No models found	
2023-03-17T08:15:11-0500
Warning	suspicious_login	Could not predict suspiciousness: No models found	
2023-03-17T08:15:11-0500
Error	core	OC\DB\Exceptions\DbalException: An exception occurred while executing a query: SQLSTATE[42S02]: Base table or view not found: 1146 Table 'nextcloud.oc_open_local_editor' doesn't exist	
2023-03-17T07:20:01-0500
Warning	suspicious_login	Could not predict suspiciousness: No models found	
2023-03-17T03:23:16-0500
Warning	suspicious_login	Could not predict suspiciousness: No models found	
2023-03-16T23:46:32-0500
Warning	suspicious_login	Could not predict suspiciousness: No models found	
2023-03-16T23:43:47-0500
Warning	suspicious_login	Could not predict suspiciousness: No models found	
2023-03-16T23:43:47-0500
Warning	suspicious_login	Could not predict suspiciousness: No models found	
2023-03-16T23:43:47-0500
Warning	suspicious_login	Could not predict suspiciousness: No models found	
2023-03-16T23:23:16-0500
Warning	suspicious_login	Could not predict suspiciousness: No models found	
2023-03-16T21:55:22-0500
Error	onlyoffice	Exception: Error occurred in the document service: Invalid token	
2023-03-16T21:47:50-0500
Error	onlyoffice	Exception: Error occurred in the document service: Invalid token	
2023-03-16T21:47:50-0500
Error	webdav	Doctrine\DBAL\Exception\DeadlockException: An exception occurred while executing a query: SQLSTATE[40001]: Serialization failure: 1213 Deadlock found when trying to get lock; try restarting transaction	
2023-03-16T21:45:02-0500
Error	webdav	Doctrine\DBAL\Exception\DeadlockException: An exception occurred while executing a query: SQLSTATE[40001]: Serialization failure: 1213 Deadlock found when trying to get lock; try restarting transaction	
2023-03-16T21:45:02-0500
Error	webdav	Doctrine\DBAL\Exception\DeadlockException: An exception occurred while executing a query: SQLSTATE[40001]: Serialization failure: 1213 Deadlock found when trying to get lock; try restarting transaction	
2023-03-16T21:45:02-0500
Error	webdav	Doctrine\DBAL\Exception\DeadlockException: An exception occurred while executing a query: SQLSTATE[40001]: Serialization failure: 1213 Deadlock found when trying to get lock; try restarting transaction	
2023-03-16T21:31:45-0500
Warning	suspicious_login	Could not predict suspiciousness: No models found	
2023-03-16T19:48:43-0500
Warning	suspicious_login	Could not predict suspiciousness: No models found	
2023-03-16T19:48:42-0500
Warning	suspicious_login	Could not predict suspiciousness: No models found	
2023-03-16T19:48:42-0500
Error	core	OC\DB\Exceptions\DbalException: An exception occurred while executing a query: SQLSTATE[42S02]: Base table or view not found: 1146 Table 'nextcloud.oc_open_local_editor' doesn't exist

Additional info

Docker image used is:
nextcloud:latest

beryl03 · 2023-03-24T23:58:10Z

My client ran out of RAM once more, and when using the List view.
It was an upload of 500 files, where almost all of them were file conflicts.
The other Out of Memory scenarios were with uploading hundreds of new files with little to no file conflicts (in grid view)
It could be upload specific.

skjnldsv · 2023-10-20T17:24:15Z

We've worked hard for the new Files performances, I think we can consider this closed for 28 🚀

beryl03 added 0. Needs triage Pending check for reproducibility or if it fits our roadmap bug labels Mar 24, 2023

szaimen added the 26-feedback label Mar 24, 2023

solracsf changed the title ~~[Bug]: Client runs of of RAM (Firefox 111.0) (Grid View)~~ [Bug]: Client runs out of RAM (Firefox 111.0) (Grid View) Mar 24, 2023

joshtrichards added feature: files feature: previews and thumbnails performance 🚀 labels Aug 30, 2023

skjnldsv added this to Legacy bugs in Files to vue via automation Sep 13, 2023

skjnldsv added 2. developing Work in progress and removed 0. Needs triage Pending check for reproducibility or if it fits our roadmap labels Sep 13, 2023

skjnldsv closed this as completed Oct 20, 2023

Files to vue automation moved this from Legacy bugs to Done Oct 20, 2023

skjnldsv added 4. to release Ready to be released and/or waiting for tests to finish and removed 2. developing Work in progress labels Oct 20, 2023

skjnldsv added this to the Nextcloud 28 milestone Oct 20, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Bug]: Client runs out of RAM (Firefox 111.0) (Grid View) #37395

[Bug]: Client runs out of RAM (Firefox 111.0) (Grid View) #37395

beryl03 commented Mar 24, 2023 •

edited

beryl03 commented Mar 24, 2023 •

edited

skjnldsv commented Oct 20, 2023

[Bug]: Client runs out of RAM (Firefox 111.0) (Grid View) #37395

[Bug]: Client runs out of RAM (Firefox 111.0) (Grid View) #37395

Comments

beryl03 commented Mar 24, 2023 • edited

⚠️ This issue respects the following points: ⚠️

Bug description

Steps to reproduce

Expected behavior

Installation method

Operating system

PHP engine version

Web server

Database engine version

Is this bug present after an update or on a fresh install?

Are you using the Nextcloud Server Encryption module?

What user-backends are you using?

Configuration report

List of activated Apps

Nextcloud Signing status

Nextcloud Logs

Additional info

beryl03 commented Mar 24, 2023 • edited

skjnldsv commented Oct 20, 2023

beryl03 commented Mar 24, 2023 •

edited

beryl03 commented Mar 24, 2023 •

edited