It takes forever to upload in web UI #5574

enoch85 · 2017-06-30T14:53:15Z

Steps to reproduce

Upload a file i web UI
Upload a file with the client
Notice the difference in time

Expected behaviour

It should be equally fast in web UI as with the client

Actual behaviour

Uploading a file in web UI results in two things:

It takes forever for some strange reason
The countdown is waaay off in web UI, while in the client it is accurate

Server configuration

Operating system: Linux cloud.techandme.se 4.4.0-81-generic #104-Ubuntu SMP Wed Jun 14 08:17:06 UTC 2017 x86_64

Web server: Apache/2.4.18 (Ubuntu) (apache2handler)

Database: mysql 5.7.18

PHP version: 7.0.18-0ubuntu0.16.04.1
Modules loaded: Core, date, libxml, openssl, pcre, zlib, filter, hash, Reflection, SPL, session, standard, apache2handler, mysqlnd, PDO, xml, calendar, ctype, curl, dom, mbstring, fileinfo, ftp, gd, gettext, iconv, imap, intl, json, ldap, exif, mcrypt, mysqli, pdo_mysql, pdo_pgsql, pdo_sqlite, pgsql, Phar, posix, readline, redis, shmop, SimpleXML, smbclient, sockets, sqlite3, sysvmsg, sysvsem, sysvshm, tokenizer, wddx, xmlreader, xmlwriter, xsl, zip, libsmbclient, Zend OPcache

Nextcloud version: 12.0.0 - 12.0.0.29

Updated from an older Nextcloud/ownCloud or fresh install:

Where did you install Nextcloud from:

Signing status:

Signing status

[]

List of activated apps:

App list

Enabled:
 - activity: 2.5.2
 - admin_notifications: 1.0.0
 - bruteforcesettings: 1.0.2
 - calendar: 1.5.3
 - comments: 1.2.0
 - contacts: 1.5.3
 - dav: 1.3.0
 - federatedfilesharing: 1.2.0
 - federation: 1.2.0
 - files: 1.7.2
 - files_downloadactivity: 1.1.1
 - files_external: 1.3.0
 - files_pdfviewer: 1.1.1
 - files_sharing: 1.4.0
 - files_texteditor: 2.4.1
 - files_trashbin: 1.2.0
 - files_versions: 1.5.0
 - files_videoplayer: 1.1.0
 - firstrunwizard: 2.1
 - gallery: 17.0.0
 - impersonate: 1.0.1
 - issuetemplate: 0.2.1
 - logreader: 2.0.0
 - lookup_server_connector: 1.0.0
 - mail: 0.6.4
 - nextcloud_announcements: 1.1
 - notes: 2.2.0
 - notifications: 2.0.0
 - oauth2: 1.0.5
 - ocsms: 1.12.0
 - ownnote: 1.08
 - password_policy: 1.2.2
 - previewgenerator: 1.0.6
 - provisioning_api: 1.2.0
 - qownnotesapi: 17.5.0
 - richdocuments: 1.12.33
 - serverinfo: 1.2.0
 - sharebymail: 1.2.0
 - socialsharing_diaspora: 1.0.1
 - socialsharing_email: 1.0.1
 - socialsharing_facebook: 1.0.1
 - socialsharing_googleplus: 1.0.1
 - socialsharing_twitter: 1.0.1
 - spreed: 2.0.1
 - survey_client: 1.0.0
 - systemtags: 1.2.0
 - theming: 1.3.0
 - twofactor_backupcodes: 1.1.1
 - twofactor_totp: 1.3.0
 - updatenotification: 1.2.0
 - workflowengine: 1.2.0

Disabled:
 - admin_audit
 - encryption
 - external
 - files_accesscontrol
 - files_automatedtagging
 - files_retention
 - user_external
 - user_ldap
 - user_saml

The content of config/config.php:

Config report

{
    "updatechecker": false,
    "passwordsalt": "***REMOVED SENSITIVE VALUE***",
    "secret": "***REMOVED SENSITIVE VALUE***",
    "trusted_domains": [
        "localhost",
        "192.168.4.111",
        "cloud.techandme.se",
        "office.techandme.se"
    ],
    "datadirectory": "\/var\/ncdata",
    "overwrite.cli.url": "https:\/\/cloud.techandme.se\/",
    "dbtype": "mysql",
    "version": "12.0.0.29",
    "dbname": "owncloud_db",
    "dbhost": "localhost",
    "dbtableprefix": "oc_",
    "dbuser": "***REMOVED SENSITIVE VALUE***",
    "dbpassword": "***REMOVED SENSITIVE VALUE***",
    "logtimezone": "Europe\/Stockholm",
    "installed": true,
    "instanceid": "oc7aii0tkiol",
    "appstore.experimental.enabled": "true",
    "mail_smtpmode": "smtp",
    "mail_smtpauth": 1,
    "mail_smtpport": "587",
    "mail_smtphost": "mail.citynetwork.se",
    "mail_smtpauthtype": "LOGIN",
    "mail_from_address": "no-reply",
    "mail_domain": "techandme.se",
    "mail_smtpname": "***REMOVED SENSITIVE VALUE***",
    "mail_smtppassword": "***REMOVED SENSITIVE VALUE***",
    "allowZipDownload": true,
    "session_lifetime": 1800,
    "forcessl": true,
    "logfile": "\/var\/log\/nfs-share\/nextcloud.log",
    "loglevel": 2,
    "memcache.local": "\\OC\\Memcache\\Redis",
    "filelocking.enabled": true,
    "memcache.distributed": "\\OC\\Memcache\\Redis",
    "memcache.locking": "\\OC\\Memcache\\Redis",
    "redis": {
        "host": "\/var\/run\/redis\/redis.sock",
        "port": 0,
        "timeout": 0,
        "dbindex": 0
    },
    "trusted_proxies": [
        [
            "192.168.4.201"
        ]
    ],
    "forwarded_for_headers": [
        "HTTP_X_FORWARDED",
        "HTTP_FORWARDED_FOR"
    ],
    "maintenance": false,
    "mail_smtpsecure": "tls",
    "htaccess.RewriteBase": "\/",
    "theme": "",
    "updater.release.channel": "stable",
    "mysql.utf8mb4": true
}

Are you using external storage, if yes which one: Array
(
[0] => \OC\Files\Storage\Local
[1] => \OCA\Files_External\Lib\Storage\FTP
[2] => \OC\Files\Storage\DAV
[3] => \OCA\Files_External\Lib\Storage\OwnCloud
[4] => \OCA\Files_External\Lib\Storage\SFTP
[5] => \OCA\Files_External\Lib\Storage\AmazonS3
[6] => \OCA\Files_External\Lib\Storage\Dropbox
[7] => \OCA\Files_External\Lib\Storage\Google
[8] => \OCA\Files_External\Lib\Storage\Swift
[9] => \OCA\Files_External\Lib\Storage\SFTP
[10] => \OCA\Files_External\Lib\Storage\SMB
[11] => \OCA\Files_External\Lib\Storage\SMB
)

Are you using encryption: no

Are you using an external user-backend, if yes which one: LDAP/ActiveDirectory/Webdav/...

Client configuration

Browser: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Ubuntu Chromium/58.0.3029.110 Chrome/58.0.3029.110 Safari/537.36

Operating system:

Logs

Web server error log

``` Insert your webserver log here ```

Nextcloud log (data/nextcloud.log)

Nextcloud log

``` Insert your Nextcloud log here ```

Browser log

``` Insert your browser log here, this could for example include:

a) The javascript console log
b) The network log
c) ...
```

The text was updated successfully, but these errors were encountered:

MorrisJobke · 2017-12-19T16:40:15Z

We improved a lot here is this still the case with 13?

enoch85 · 2017-12-19T17:01:45Z

In 13.0.0beta3 it doesn't even upload and gives: TypeError: response is undefined

https://developer.mozilla.org/sv-SE/docs/Web/JavaScript/Reference/Errors/Unexpected_type?utm_source=mozilla&utm_medium=firefox-console-errors&utm_campaign=default

Tried both with upload button and drag&drop

MorrisJobke · 2017-12-19T17:04:21Z

cc @danxuliu @rullzer @ChristophWurst

enoch85 · 2017-12-19T17:08:43Z

Btw, switched to PostgreSQL (9.6) since posting this issue, still same behaviour as on MySQL.

rullzer · 2017-12-19T19:00:38Z

I can upload just fine here.

Does it fail for all files you throw at it?

enoch85 · 2017-12-19T19:07:55Z

Just checked a bit closer and this is the most recent logoutput:

Please edit the lines

{"reqId":"ACrwUL5PMH3p5QpfaKpp","level":4,"time":"2017-12-19T20:04:38+01:00","remoteAddr":"192.168.4.201","user":"daniel@en0ch.se","app":"webdav","method":"MKCOL","url":"\/remote.php\/dav\/uploads\/daniel%2540en0ch.se\/web-file-upload-e54cb781b4244afb5756efd997d3ecdd-1513710278340","message":"Exception: {\"Exception\":\"Sabre\\\\DAV\\\\Exception\\\\Conflict\",\"Message\":\"Parent node does not exist\",\"Code\":0,\"Trace\":\"#0 \\\/var\\\/www\\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/CorePlugin.php(590): Sabre\\\\DAV\\\\Server->createCollection('uploads\\\/daniel%...', Object(Sabre\\\\DAV\\\\MkCol))\\n#1 [internal function]: Sabre\\\\DAV\\\\CorePlugin->httpMkcol(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#2 \\\/var\\\/www\\\/nextcloud\\\/3rdparty\\\/sabre\\\/event\\\/lib\\\/EventEmitterTrait.php(105): call_user_func_array(Array, Array)\\n#3 \\\/var\\\/www\\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(479): Sabre\\\\Event\\\\EventEmitter->emit('method:MKCOL', Array)\\n#4 \\\/var\\\/www\\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(254): Sabre\\\\DAV\\\\Server->invokeMethod(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#5 \\\/var\\\/www\\\/nextcloud\\\/apps\\\/dav\\\/lib\\\/Server.php(281): Sabre\\\\DAV\\\\Server->exec()\\n#6 \\\/var\\\/www\\\/nextcloud\\\/apps\\\/dav\\\/appinfo\\\/v2\\\/remote.php(35): OCA\\\\DAV\\\\Server->exec()\\n#7 \\\/var\\\/www\\\/nextcloud\\\/remote.php(164): require_once('\\\/var\\\/www\\\/nextcl...')\\n#8 {main}\",\"File\":\"\\\/var\\\/www\\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php\",\"Line\":1167}","userAgent":"Mozilla\/5.0 (X11; Ubuntu; Linux x86_64; rv:57.0) Gecko\/20100101 Firefox\/57.0","version":"13.0.0.8"}

Small files are good, but not files over a few MB.

enoch85 · 2018-01-09T17:07:24Z

Same error in 13.0.0beta4. Files over a few MB won't upload. (No it isn't upload_max that's the problem here)

rullzer · 2018-01-09T22:14:54Z

so it seems something fishy is going on in the uploads endpoint.

what is your user backend?
what is your userid?
did you use your e-mail to login?

rullzer · 2018-01-10T07:34:55Z

I think I have a fix. PR incomming.

enoch85 · 2018-01-10T13:03:39Z

@rullzer I think you fixed it, without testing it seems you cached the correct bug. My username is daniel@something.com and your description in the PR nails my issue.

I'l test the PR when I come home.

enoch85 added bug enhancement feature: dav feature: filesystem technical debt and removed bug labels Jun 30, 2017

MorrisJobke added this to the Nextcloud 13 milestone Dec 19, 2017

MorrisJobke added bug and removed enhancement technical debt labels Dec 19, 2017

rullzer mentioned this issue Jan 10, 2018

Don't encode paths that will be passed to the davclient #7765

Merged

rullzer self-assigned this Jan 10, 2018

MorrisJobke closed this as completed in #7765 Jan 10, 2018

nextcloud-bot mentioned this issue Aug 16, 2018

Upload Problem on Web Browsers #10711

Closed

snyk-bot mentioned this issue Sep 2, 2020

[Snyk] Fix for 5 vulnerabilities dwoodiwiss/server#1

Merged

snyk-bot mentioned this issue Jun 15, 2021

[Snyk] Fix for 15 vulnerabilities Mugetsu15/server#1

Merged

snyk-bot mentioned this issue Oct 7, 2022

[Snyk] Fix for 25 vulnerabilities TomG736/server#14

Open

TomG736 mentioned this issue Oct 8, 2022

[Snyk] Fix for 25 vulnerabilities TomG736/server#15

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

It takes forever to upload in web UI #5574

It takes forever to upload in web UI #5574

enoch85 commented Jun 30, 2017 •

edited by rullzer

Loading

MorrisJobke commented Dec 19, 2017

enoch85 commented Dec 19, 2017 •

edited

Loading

MorrisJobke commented Dec 19, 2017

enoch85 commented Dec 19, 2017 •

edited

Loading

rullzer commented Dec 19, 2017

enoch85 commented Dec 19, 2017 •

edited

Loading

enoch85 commented Jan 9, 2018

rullzer commented Jan 9, 2018

rullzer commented Jan 10, 2018

enoch85 commented Jan 10, 2018

It takes forever to upload in web UI #5574

It takes forever to upload in web UI #5574

Comments

enoch85 commented Jun 30, 2017 • edited by rullzer Loading

Steps to reproduce

Expected behaviour

Actual behaviour

Server configuration

Client configuration

Logs

Web server error log

Nextcloud log (data/nextcloud.log)

Browser log

MorrisJobke commented Dec 19, 2017

enoch85 commented Dec 19, 2017 • edited Loading

MorrisJobke commented Dec 19, 2017

enoch85 commented Dec 19, 2017 • edited Loading

rullzer commented Dec 19, 2017

enoch85 commented Dec 19, 2017 • edited Loading

enoch85 commented Jan 9, 2018

rullzer commented Jan 9, 2018

rullzer commented Jan 10, 2018

enoch85 commented Jan 10, 2018

enoch85 commented Jun 30, 2017 •

edited by rullzer

Loading

enoch85 commented Dec 19, 2017 •

edited

Loading

enoch85 commented Dec 19, 2017 •

edited

Loading

enoch85 commented Dec 19, 2017 •

edited

Loading