Synchronizing small files = very slow #7072

Closed
gluap opened this Issue Feb 4, 2014 · 155 comments

Comments

Projects
None yet
@gluap

gluap commented Feb 4, 2014

Expected behaviour

Files sync at about the speed of the broadband connection, independent of size unless limited by CPU or IO on client or server.

Actual behaviour

Synchronizing a folder with many small files is terribly slow. For instance a test folder with 10k 3-byte-files synchronizes with a speed of about 1 file per second over a broadband connection. The load on both client and server while doing this is negligible. Tested with server running Ubuntu 12.04 with current owncloud 6.0.1-1, client current Linux or Macos clients. The transfer rates on the broadband connection are very low as well, so this is not the bottleneck.

Steps to reproduce

  1. Download http://xn--grgen-jua.name/owncloudStressTest.tar.bz2
  2. unpack it into an owncloud folder that syncs with a remote owncloud machine.
  3. Observe upload speeds of one to a few 3-byte-files per second.

Server configuration

Operating system: Ubuntu 12.04

Web server: lighttpd

Database: mysql

PHP version: PHP 5.3.10-1ubuntu3.9

ownCloud version: 6.0.1-1

Updated from an older ownCloud or fresh install: Updated from ownCloud 5

The content of config/config.php:
$CONFIG = array ( 'instanceid' => 'removed', 'passwordsalt' => 'removed', 'datadirectory' => '/var/www/owncloud/data', 'dbtype' => 'mysql', 'version' => '6.0.0.16', 'dbname' => 'dropbox', 'dbhost' => 'localhost', 'dbtableprefix' => 'removed', 'dbuser' => 'removed', 'dbpassword' => 'removed', 'installed' => true, 'theme' => '', 'maintenance' => false, );

no external storage used.

Log files do not show error messages or warnings that seem related.

Client configuration

Both MacosX and Ubuntu 13.10 running current owncloud versions are affected. Browser was not used.

Why I think this is an issue

I regularly sync folders with several thousands of files. I think I am not the only one.

What I think is the reason

I am guessing that owncloud does at least one if not several http requests per file sent. It works sequentially, so the next file can only be sent when the last file is acknowledged. Therefore while preparing the request takes no time and effort, and storing the file does not either, the network delay comes into play: For each file to be sent you have to wait at least one if not several round-trip times.

Another indication is that syncing the folder on the local network or between two VMs on the same machine is much faster. This emphasizes the network delay being of importance in this scenario.

How I think it could be circumvented

Sync not file-by-file but instead several files per request, at least if the files are small.

@loripino21

This comment has been minimized.

Show comment
Hide comment
@loripino21

loripino21 Feb 4, 2014

Or, sync with multiple threads and split the work. Much more easy.
Only one thread search for the files to sync, splits the list of files to be uploaded, and starts the threads.

Or, sync with multiple threads and split the work. Much more easy.
Only one thread search for the files to sync, splits the list of files to be uploaded, and starts the threads.

@PVince81

This comment has been minimized.

Show comment
Hide comment
@PVince81

PVince81 Feb 4, 2014

Member

@dragotin did you guys have plans looking into uploading multiple files through the same connection ?

Member

PVince81 commented Feb 4, 2014

@dragotin did you guys have plans looking into uploading multiple files through the same connection ?

@PVince81

This comment has been minimized.

Show comment
Hide comment
@PVince81

PVince81 Feb 4, 2014

Member

Just had a try locally, using "localhost" and the sync client is able to upload many files within a second:
stresstest

I can imagine that each connection might take more time over the internet, also if it includes name resolution.

Have you tried directly with the IP address to rule out the name resolution case ?

Member

PVince81 commented Feb 4, 2014

Just had a try locally, using "localhost" and the sync client is able to upload many files within a second:
stresstest

I can imagine that each connection might take more time over the internet, also if it includes name resolution.

Have you tried directly with the IP address to rule out the name resolution case ?

@PVince81 PVince81 added the Bug label Feb 4, 2014

@gluap

This comment has been minimized.

Show comment
Hide comment
@gluap

gluap Feb 4, 2014

I used the IP directly (or rather a name, but one which is taken from /etc/hosts, not looked up via DNS). I can reproduce your results when uploading locally. Unfortunately fast local performance is academic as the usual case will be a server somewhere on the internet.

gluap commented Feb 4, 2014

I used the IP directly (or rather a name, but one which is taken from /etc/hosts, not looked up via DNS). I can reproduce your results when uploading locally. Unfortunately fast local performance is academic as the usual case will be a server somewhere on the internet.

@PVince81

This comment has been minimized.

Show comment
Hide comment
@PVince81

PVince81 Feb 4, 2014

Member

It still feels a bit slow, this is about 41 M which I'd expect to be uploaded much faster.
The problem also is that it might wait for the server to finish creating/saving/indexing the file before continuing, as the server won't give an answer until that happened.

Member

PVince81 commented Feb 4, 2014

It still feels a bit slow, this is about 41 M which I'd expect to be uploaded much faster.
The problem also is that it might wait for the server to finish creating/saving/indexing the file before continuing, as the server won't give an answer until that happened.

@PVince81

This comment has been minimized.

Show comment
Hide comment
@PVince81

PVince81 Feb 4, 2014

Member

I tried with the tar file without compression (bunzip2) which is 11Mb big, it took less than a second to upload. I'd almost think that before uploading many files those could be tar'ed together, uploaded then untarred on the server...

Member

PVince81 commented Feb 4, 2014

I tried with the tar file without compression (bunzip2) which is 11Mb big, it took less than a second to upload. I'd almost think that before uploading many files those could be tar'ed together, uploaded then untarred on the server...

@gluap

This comment has been minimized.

Show comment
Hide comment
@gluap

gluap Feb 4, 2014

Yes I was thinking about something like that when I said "multiple files per request". I think the issue is really delay somehwere on the way. However It seems to be not only the round-trip time. A ping to my server says roundtrip is only 6 miliseconds, so I am wondering where the rest of the time is spent. My accesslog looks like:

<my ip> frickel - [04/Feb/2014:19:20:38 +0100] "PUT /owncloud/remote.php/webdav/owncloudtest/36/42.txt HTTP/1.1" 201 0 "-" "Mozilla/5.0 (Macintosh) csyncoC/0.91.4 neon/0.30.0"
<my ip> frickel - [04/Feb/2014:19:20:40 +0100] "PUT /owncloud/remote.php/webdav/owncloudtest/36/43.txt HTTP/1.1" 201 0 "-" "Mozilla/5.0 (Macintosh) csyncoC/0.91.4 neon/0.30.0"
<my ip> frickel - [04/Feb/2014:19:20:42 +0100] "PUT /owncloud/remote.php/webdav/owncloudtest/36/44.txt HTTP/1.1" 201 0 "-" "Mozilla/5.0 (Macintosh) csyncoC/0.91.4 neon/0.30.0"
<my ip> frickel - [04/Feb/2014:19:20:44 +0100] "PUT /owncloud/remote.php/webdav/owncloudtest/36/45.txt HTTP/1.1" 201 0 "-" "Mozilla/5.0 (Macintosh) csyncoC/0.91.4 neon/0.30.0"
<my ip> frickel - [04/Feb/2014:19:20:46 +0100] "PUT /owncloud/remote.php/webdav/owncloudtest/36/46.txt HTTP/1.1" 201 0 "-" "Mozilla/5.0 (Macintosh) csyncoC/0.91.4 neon/0.30.0"

Load on both client and server are negligible. Still only 1 file in two seconds.

The results are reproducable on a second server (also ubuntu 12.04, but apache instead of lighttpd). Round trip (ping) for the second server is 14ms.

Uploading several files at once might also allow to add several files to the database at once, in case that is the bottleneck.

gluap commented Feb 4, 2014

Yes I was thinking about something like that when I said "multiple files per request". I think the issue is really delay somehwere on the way. However It seems to be not only the round-trip time. A ping to my server says roundtrip is only 6 miliseconds, so I am wondering where the rest of the time is spent. My accesslog looks like:

<my ip> frickel - [04/Feb/2014:19:20:38 +0100] "PUT /owncloud/remote.php/webdav/owncloudtest/36/42.txt HTTP/1.1" 201 0 "-" "Mozilla/5.0 (Macintosh) csyncoC/0.91.4 neon/0.30.0"
<my ip> frickel - [04/Feb/2014:19:20:40 +0100] "PUT /owncloud/remote.php/webdav/owncloudtest/36/43.txt HTTP/1.1" 201 0 "-" "Mozilla/5.0 (Macintosh) csyncoC/0.91.4 neon/0.30.0"
<my ip> frickel - [04/Feb/2014:19:20:42 +0100] "PUT /owncloud/remote.php/webdav/owncloudtest/36/44.txt HTTP/1.1" 201 0 "-" "Mozilla/5.0 (Macintosh) csyncoC/0.91.4 neon/0.30.0"
<my ip> frickel - [04/Feb/2014:19:20:44 +0100] "PUT /owncloud/remote.php/webdav/owncloudtest/36/45.txt HTTP/1.1" 201 0 "-" "Mozilla/5.0 (Macintosh) csyncoC/0.91.4 neon/0.30.0"
<my ip> frickel - [04/Feb/2014:19:20:46 +0100] "PUT /owncloud/remote.php/webdav/owncloudtest/36/46.txt HTTP/1.1" 201 0 "-" "Mozilla/5.0 (Macintosh) csyncoC/0.91.4 neon/0.30.0"

Load on both client and server are negligible. Still only 1 file in two seconds.

The results are reproducable on a second server (also ubuntu 12.04, but apache instead of lighttpd). Round trip (ping) for the second server is 14ms.

Uploading several files at once might also allow to add several files to the database at once, in case that is the bottleneck.

@gluap

This comment has been minimized.

Show comment
Hide comment
@gluap

gluap Feb 4, 2014

@PVince81 Are you sure it is several files a second locally? The timestamp in the image you posted are in hours:minutes.

gluap commented Feb 4, 2014

@PVince81 Are you sure it is several files a second locally? The timestamp in the image you posted are in hours:minutes.

@PVince81

This comment has been minimized.

Show comment
Hide comment
@PVince81

PVince81 Feb 4, 2014

Member

@gluap hmm right. I was actually looking at the progress bar and saw the file name changing 3-4 times within a second and thought the log would reflect that.

Member

PVince81 commented Feb 4, 2014

@gluap hmm right. I was actually looking at the progress bar and saw the file name changing 3-4 times within a second and thought the log would reflect that.

@ghost

This comment has been minimized.

Show comment
Hide comment
@ghost

ghost Feb 4, 2014

@gulap

You might also want to check one of this reported issues: owncloud/client#331, #5084, #3118, owncloud/client#209 and many more of the same/similar reports.

ghost commented Feb 4, 2014

@gulap

You might also want to check one of this reported issues: owncloud/client#331, #5084, #3118, owncloud/client#209 and many more of the same/similar reports.

@gluap

This comment has been minimized.

Show comment
Hide comment
@gluap

gluap Feb 4, 2014

@RealRancor: thanks for the hint. Apparently my search before creating the issue was not thorough enough. My apologies.
I think I am seeing the same problems as #3118 and owncloud/client#209 and possibly owncloud/client#331. I hope my method of reproducing the issue helps a little. For me this issue is a real dealbreaker.

gluap commented Feb 4, 2014

@RealRancor: thanks for the hint. Apparently my search before creating the issue was not thorough enough. My apologies.
I think I am seeing the same problems as #3118 and owncloud/client#209 and possibly owncloud/client#331. I hope my method of reproducing the issue helps a little. For me this issue is a real dealbreaker.

@enoch85

This comment has been minimized.

Show comment
Hide comment
@enoch85

enoch85 Feb 4, 2014

Member

Dont know if it helps you guys, but theese are my results.

100/10 Mbit/s Server
100/10 Mbit Client.

oc

oc2

Member

enoch85 commented Feb 4, 2014

Dont know if it helps you guys, but theese are my results.

100/10 Mbit/s Server
100/10 Mbit Client.

oc

oc2

@jcfischer

This comment has been minimized.

Show comment
Hide comment
@jcfischer

jcfischer Feb 4, 2014

Contributor

We are in the same boat (and have filed #6937 ). I have traced the application with New Relic and I see hundreds of SELECTs for every file uploaded - that slows the processing down considerably.

Contributor

jcfischer commented Feb 4, 2014

We are in the same boat (and have filed #6937 ). I have traced the application with New Relic and I see hundreds of SELECTs for every file uploaded - that slows the processing down considerably.

@gluap

This comment has been minimized.

Show comment
Hide comment
@gluap

gluap Feb 5, 2014

@jcfischer Would it be correct to summarize the current results of #6937 as "The main delay of transferring a small file comes from the fact that
a) every file transfer generates a ton of SQL requests and
b) files are transferred serially"?

gluap commented Feb 5, 2014

@jcfischer Would it be correct to summarize the current results of #6937 as "The main delay of transferring a small file comes from the fact that
a) every file transfer generates a ton of SQL requests and
b) files are transferred serially"?

@jcfischer

This comment has been minimized.

Show comment
Hide comment
@jcfischer

jcfischer Feb 5, 2014

Contributor

I can't say conclusively yet. Yes, there are a ton of SQL requests which cost time.

Yes, every HTTP request incurs startup cost (I measure 60ms as the baseline for ownCloud - this is the time it takes status.php to load and I assume that this is loading and initializing the complete ownCloud stack.

I don't know if there are more time sinks involved.

Sent from my iPhone

On 05.02.2014, at 10:42, gluap notifications@github.com wrote:

@jcfischer Would it be correct to summarize the current results of #6937 as "The main delay of transferring a small file comes from the fact that
a) every file transfer generates a ton of SQL requests and
b) files are transferred serially"?


Reply to this email directly or view it on GitHub.

Contributor

jcfischer commented Feb 5, 2014

I can't say conclusively yet. Yes, there are a ton of SQL requests which cost time.

Yes, every HTTP request incurs startup cost (I measure 60ms as the baseline for ownCloud - this is the time it takes status.php to load and I assume that this is loading and initializing the complete ownCloud stack.

I don't know if there are more time sinks involved.

Sent from my iPhone

On 05.02.2014, at 10:42, gluap notifications@github.com wrote:

@jcfischer Would it be correct to summarize the current results of #6937 as "The main delay of transferring a small file comes from the fact that
a) every file transfer generates a ton of SQL requests and
b) files are transferred serially"?


Reply to this email directly or view it on GitHub.

@sunny-user

This comment has been minimized.

Show comment
Hide comment
@sunny-user

sunny-user Feb 7, 2014

I´m using the OwnCloud Sync Tool for windows to sync about 100.000 files.
In my activity log I can see, that it takes more and more time for uploading a file as the number of uploaded files increase. The first files took about 2 seconds, now I uploaded 9000 files to 1und1.de and it takes about 17 seconds. The more files there are uploaded, the more time needs a file to upload. Because of small files the internet transfer speed does not play any role.
I would say, Owncloud has a very bad database / transaction design. It needs a much better structure / programming for much better performance.

I´m using the OwnCloud Sync Tool for windows to sync about 100.000 files.
In my activity log I can see, that it takes more and more time for uploading a file as the number of uploaded files increase. The first files took about 2 seconds, now I uploaded 9000 files to 1und1.de and it takes about 17 seconds. The more files there are uploaded, the more time needs a file to upload. Because of small files the internet transfer speed does not play any role.
I would say, Owncloud has a very bad database / transaction design. It needs a much better structure / programming for much better performance.

@PVince81

This comment has been minimized.

Show comment
Hide comment

@karlitschek karlitschek added Enhancement and removed Bug labels Feb 25, 2014

@nickbunyan

This comment has been minimized.

Show comment
Hide comment
@nickbunyan

nickbunyan Mar 1, 2014

Having worked with a variety of backup transfer products professionally for some years I am afraid to say there appears to be a fundamental problem with the methodology being used for Client syncing.

Without going into the specifics of how OC is working it clearly should not rely on sequential transfer of individual files when 'adding' a new folder and yet it appears to be issuing multiple queries to the server before even considering uploading each file.

Clearly this type of activity should be handled in a batch fashion - perhaps by allowing the client to toggle a setting - or simply warning that the number of 'new' files means it will work in batch mode only until the new folder sync is completed.

As an example, Batch Mode could mean that all files from the 'New Folder' are uploaded to a temporary location on the server, the server resources are then used to 'Scan' the folder and create records for each of the new files, setting timestamps etc and migrating the files to their proper place. At the end of the process Batch Mode is turned off and a consistency check is performed.

After tweaking MySQL settings and cache and so forth I have got to a situation where OC running on Ubuntu 12.04, with 1.5.1 on Windows 7 works well enough to be usable for general day to day updates but if you need to include another folder; do it like this:- Use Filezilla or similar to copy the original files to the correct location on the Server. Change the permissions on the uploaded files to match the rest of the OC files. Add the folder to Owncloud at the Client side. Wait while the Client syncs all the 'New Files' down from the server. [It still takes a while, but hours rather than weeks].

This project has fantastic potential, but the fundamental architecture just doesn't appear to scale, sadly.

Having worked with a variety of backup transfer products professionally for some years I am afraid to say there appears to be a fundamental problem with the methodology being used for Client syncing.

Without going into the specifics of how OC is working it clearly should not rely on sequential transfer of individual files when 'adding' a new folder and yet it appears to be issuing multiple queries to the server before even considering uploading each file.

Clearly this type of activity should be handled in a batch fashion - perhaps by allowing the client to toggle a setting - or simply warning that the number of 'new' files means it will work in batch mode only until the new folder sync is completed.

As an example, Batch Mode could mean that all files from the 'New Folder' are uploaded to a temporary location on the server, the server resources are then used to 'Scan' the folder and create records for each of the new files, setting timestamps etc and migrating the files to their proper place. At the end of the process Batch Mode is turned off and a consistency check is performed.

After tweaking MySQL settings and cache and so forth I have got to a situation where OC running on Ubuntu 12.04, with 1.5.1 on Windows 7 works well enough to be usable for general day to day updates but if you need to include another folder; do it like this:- Use Filezilla or similar to copy the original files to the correct location on the Server. Change the permissions on the uploaded files to match the rest of the OC files. Add the folder to Owncloud at the Client side. Wait while the Client syncs all the 'New Files' down from the server. [It still takes a while, but hours rather than weeks].

This project has fantastic potential, but the fundamental architecture just doesn't appear to scale, sadly.

@Supermathie

This comment has been minimized.

Show comment
Hide comment
@Supermathie

Supermathie Mar 26, 2014

@sunny-user I experienced this as well and tracked it down to the oc_jobs table - as the number of jobs increases the cost of adding a new one increases as well, leading to higher web transactional latency and cpu% on the DBMS getting higher and higher.

Turns out the cron job which processes scheduled jobs wasn't running. This made a huge difference right away.

But... I have other problems. Specifically, discovering that sync performance scales linearly with # of directories.

@sunny-user I experienced this as well and tracked it down to the oc_jobs table - as the number of jobs increases the cost of adding a new one increases as well, leading to higher web transactional latency and cpu% on the DBMS getting higher and higher.

Turns out the cron job which processes scheduled jobs wasn't running. This made a huge difference right away.

But... I have other problems. Specifically, discovering that sync performance scales linearly with # of directories.

@ralphholzmann

This comment has been minimized.

Show comment
Hide comment
@ralphholzmann

ralphholzmann Apr 18, 2014

Migrating to ownCloud from Dropbox, and currently feeling the pain of this issue as well :(

Migrating to ownCloud from Dropbox, and currently feeling the pain of this issue as well :(

@ralphholzmann

This comment has been minimized.

Show comment
Hide comment
@ralphholzmann

ralphholzmann Apr 18, 2014

@RealRancor Yep. Still no luck. Still extremely slow. Here's a video to illustrate the pain with small files (less than 100k).

https://dl.dropboxusercontent.com/u/47777/slow_own_cloud.mov

@RealRancor Yep. Still no luck. Still extremely slow. Here's a video to illustrate the pain with small files (less than 100k).

https://dl.dropboxusercontent.com/u/47777/slow_own_cloud.mov

@ghost

This comment has been minimized.

Show comment
Hide comment
@ghost

ghost Apr 18, 2014

Hi,

@ralphholzmann

Posting a video is probably not very useful in this case as it don't say anything about your environment. If you're running SQLite you might want to try to change your environment to a "real" Database like MySQL or PostgreSQL.

ghost commented Apr 18, 2014

Hi,

@ralphholzmann

Posting a video is probably not very useful in this case as it don't say anything about your environment. If you're running SQLite you might want to try to change your environment to a "real" Database like MySQL or PostgreSQL.

@ralphholzmann

This comment has been minimized.

Show comment
Hide comment
@ralphholzmann

ralphholzmann Apr 18, 2014

@RealRancor the reason I posted the video is because there was confusion about timestamps in the activity pane earlier in the thread and the video provided a much better visual of the problem -- but to answer your question, I'm running ownCloud 6.0.2 on my Netgear ReadyNAS connected to my local network, and it's configured to use MySQL.

@RealRancor the reason I posted the video is because there was confusion about timestamps in the activity pane earlier in the thread and the video provided a much better visual of the problem -- but to answer your question, I'm running ownCloud 6.0.2 on my Netgear ReadyNAS connected to my local network, and it's configured to use MySQL.

@tetsuo76

This comment has been minimized.

Show comment
Hide comment
@tetsuo76

tetsuo76 May 12, 2014

I am facing the same problem while trying to sync a large netbeans project which includes a .git repository. It takes ownCloud around 2-3 seconds for each file and most of them are less than 1kb. Sync'ing 20,000 files (~200mb in total) takes me almost a day..

I am facing the same problem while trying to sync a large netbeans project which includes a .git repository. It takes ownCloud around 2-3 seconds for each file and most of them are less than 1kb. Sync'ing 20,000 files (~200mb in total) takes me almost a day..

@nerzhul

This comment has been minimized.

Show comment
Hide comment
@nerzhul

nerzhul May 13, 2014

I have the same problem, users with many files are waiting many time. I tested on MySQL 5.5 and PostgreSQL 9.2, same problem (it's database clusters, optimized for performance)

nerzhul commented May 13, 2014

I have the same problem, users with many files are waiting many time. I tested on MySQL 5.5 and PostgreSQL 9.2, same problem (it's database clusters, optimized for performance)

@andydvsn

This comment has been minimized.

Show comment
Hide comment
@andydvsn

andydvsn May 19, 2014

I'm experiencing exactly the same issue; I keep a backup copy of my Aperture library in Dropbox and have been attempting to sync it to my server with ownCloud. Many small files in there.

Using the current 1.6.0rc2 client on OS X, connecting to ownCloud on Ubuntu 14.04 (Apache 2.4, MySQL 5.5) and the small files are taking forever - very similar performance as shown by the @ralphholzmann video (approximately 1 file per second, usually around 2-3KB each). Destination server is a dedicated 2GHz Intel Atom box in a data centre with solid 100Mbps connection, client machine is on JANET, so bandwidth is no issue. Individual large files transfer extremely quickly.

I'm experiencing exactly the same issue; I keep a backup copy of my Aperture library in Dropbox and have been attempting to sync it to my server with ownCloud. Many small files in there.

Using the current 1.6.0rc2 client on OS X, connecting to ownCloud on Ubuntu 14.04 (Apache 2.4, MySQL 5.5) and the small files are taking forever - very similar performance as shown by the @ralphholzmann video (approximately 1 file per second, usually around 2-3KB each). Destination server is a dedicated 2GHz Intel Atom box in a data centre with solid 100Mbps connection, client machine is on JANET, so bandwidth is no issue. Individual large files transfer extremely quickly.

@enoch85

This comment has been minimized.

Show comment
Hide comment
@enoch85

enoch85 May 19, 2014

Member

Just wanted to show in opposite to the @ralphholzmann video - it has become faster:

http://goo.gl/VI1u2k

1.6.0rc2
OC 6.0.3
MySQL 5.5

100 Mbit/s down and 10 Mbit/s up

Member

enoch85 commented May 19, 2014

Just wanted to show in opposite to the @ralphholzmann video - it has become faster:

http://goo.gl/VI1u2k

1.6.0rc2
OC 6.0.3
MySQL 5.5

100 Mbit/s down and 10 Mbit/s up

@andydvsn

This comment has been minimized.

Show comment
Hide comment
@andydvsn

andydvsn May 19, 2014

Wish I could see that - and I should have mentioned that I am also running OC 6.0.3. What hardware are you on @enoch85?

http://goo.gl/B124pK

This is what I'm seeing. Letting it complete just for interests' sake. Server and client are both pretty quiet so far as resource usage goes.

Wish I could see that - and I should have mentioned that I am also running OC 6.0.3. What hardware are you on @enoch85?

http://goo.gl/B124pK

This is what I'm seeing. Letting it complete just for interests' sake. Server and client are both pretty quiet so far as resource usage goes.

@enoch85

This comment has been minimized.

Show comment
Hide comment
@enoch85

enoch85 May 19, 2014

Member

@birdslikewires Wow! I get your point.

This is my system:
Operating system Ubuntu Server Linux 12.04.3
Kernel and CPU Linux 3.8.0-39-generic on x86_64
Processor information Intel(R) Core(TM) i5-3570K CPU @ 3.40GHz, 4 cores (overclocked to 4.6GHz)
RAM: 16 GB DDR3 (2048 MB is used for Linux)

I run it as a virtual machine in VMware Workstation 10.X with Windows 7 Ultimate as host and Ubuntu as guest.

Member

enoch85 commented May 19, 2014

@birdslikewires Wow! I get your point.

This is my system:
Operating system Ubuntu Server Linux 12.04.3
Kernel and CPU Linux 3.8.0-39-generic on x86_64
Processor information Intel(R) Core(TM) i5-3570K CPU @ 3.40GHz, 4 cores (overclocked to 4.6GHz)
RAM: 16 GB DDR3 (2048 MB is used for Linux)

I run it as a virtual machine in VMware Workstation 10.X with Windows 7 Ultimate as host and Ubuntu as guest.

@ArjenR

This comment has been minimized.

Show comment
Hide comment
@ArjenR

ArjenR Jun 23, 2014

Hi all,
IMHO the speed issue is within the manner chosen to handle the process of nested iterations over filerecords in php-code(!), rather then in SQL with some proper (self)joins. Handling it in code creates O^n operations rather than some nice linear n*O.

It just needs a proper rethink where one good SQL query delivers only one good recordset over which the code iterates only once. Only branching off to do perhaps one insert or update statement, which may create multiple records or updates.

Kind regards, Arjen

ArjenR commented Jun 23, 2014

Hi all,
IMHO the speed issue is within the manner chosen to handle the process of nested iterations over filerecords in php-code(!), rather then in SQL with some proper (self)joins. Handling it in code creates O^n operations rather than some nice linear n*O.

It just needs a proper rethink where one good SQL query delivers only one good recordset over which the code iterates only once. Only branching off to do perhaps one insert or update statement, which may create multiple records or updates.

Kind regards, Arjen

@enoch85

This comment has been minimized.

Show comment
Hide comment
@enoch85

enoch85 Aug 13, 2014

Member

Speed has improved alot with ownCloud 7.0.1 + Mirall 1.7.0 alpha1. Give it a try.

Member

enoch85 commented Aug 13, 2014

Speed has improved alot with ownCloud 7.0.1 + Mirall 1.7.0 alpha1. Give it a try.

@andydvsn

This comment has been minimized.

Show comment
Hide comment
@andydvsn

andydvsn Aug 13, 2014

Thanks for the update. Will have to give it a whirl.

Thanks for the update. Will have to give it a whirl.

@VincentvgNn

This comment has been minimized.

Show comment
Hide comment
@VincentvgNn

VincentvgNn Aug 13, 2014

Great that there is a speed improvement within the current architecture!

I'm testing ownCloud on data integrity and therefore I'm uploading and downloading a lot of files/folders. Yesterday I was at 1,6GB 10.000 files 750 folders and started experiencing the problems mentioned here. My server is at a website hosting provider where I have 5GB available at a limited speed and with some interruptions.
At the increasing amount of data I see:

  1. A drastically increasing time for "Prepare to sync".
  2. An upload speed slow down to about one 2kB file per 5 seconds.
    (client 1.6.2. server 7.0.1)
    Googling on the words: "ownCloud preparing to sync takes long time Github", shows that there are more issues with probably the same root cause.

On March 1st 2014 nickbunyan wrote here on this issue:
"This project has fantastic potential, but the fundamental architecture just doesn't appear to scale, sadly."

IMO the scale-ability should be in some next OC version.
It's for sure that the amount of data stored in the cloud will increase drastically.
The fundamental architecture should not limit the amount of data or the data transfer speed.
That is the only way to get rid of these issues coming back again and again.

Anyhow I subscribe that: "ownCloud is a fantastic project!"

Great that there is a speed improvement within the current architecture!

I'm testing ownCloud on data integrity and therefore I'm uploading and downloading a lot of files/folders. Yesterday I was at 1,6GB 10.000 files 750 folders and started experiencing the problems mentioned here. My server is at a website hosting provider where I have 5GB available at a limited speed and with some interruptions.
At the increasing amount of data I see:

  1. A drastically increasing time for "Prepare to sync".
  2. An upload speed slow down to about one 2kB file per 5 seconds.
    (client 1.6.2. server 7.0.1)
    Googling on the words: "ownCloud preparing to sync takes long time Github", shows that there are more issues with probably the same root cause.

On March 1st 2014 nickbunyan wrote here on this issue:
"This project has fantastic potential, but the fundamental architecture just doesn't appear to scale, sadly."

IMO the scale-ability should be in some next OC version.
It's for sure that the amount of data stored in the cloud will increase drastically.
The fundamental architecture should not limit the amount of data or the data transfer speed.
That is the only way to get rid of these issues coming back again and again.

Anyhow I subscribe that: "ownCloud is a fantastic project!"

@dragotin

This comment has been minimized.

Show comment
Hide comment
@dragotin

dragotin Aug 13, 2014

Contributor

On 13.08.2014 13:51, VincentvgNn wrote:

At the increasing amount of data I see:

  1. A drastically increasing time for "Prepare to sync".

How do you see or meassure that? Can you elaborate on that?

Contributor

dragotin commented Aug 13, 2014

On 13.08.2014 13:51, VincentvgNn wrote:

At the increasing amount of data I see:

  1. A drastically increasing time for "Prepare to sync".

How do you see or meassure that? Can you elaborate on that?

@enoch85

This comment has been minimized.

Show comment
Hide comment
@enoch85

enoch85 Aug 4, 2015

Member

@ghiamar Just as a reference:

Client
1.8.4

Server
ownCloud Version: 8.1.0-3
Ubuntu Server 14.04
Apache/2.4.7
PHP 5.5.9
libmysql - 5.5.44

HDDs on server
WD Red (NAS edition) RAID1

Testfiles
https://www.en0ch.se/stress-test/

Time to complete sync
Start Time - End Time:
23:53:37 - 23:59:00 (About 6 minutes)

Network
(LAN) 100 Mbit/s down / 100 Mbit/s up

Top

load average: 1.34, 0.89, 0.41
Tasks: 272 total,   2 running, 270 sleeping,   0 stopped,   0 zombie
%Cpu(s): 11.1 us,  5.8 sy,  0.0 ni, 60.1 id,  6.1 wa,  0.0 hi, 16.9 si,  0.0 st
KiB Mem:   2043140 total,  1977136 used,    66004 free,   137888 buffers
KiB Swap:        0 total,        0 used,        0 free.  1120100 cached Mem

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
 1314 mysql     20   0 1140928 113416   7732 S  52.2  5.6   2:36.22 mysqld
 3046 www-data  20   0  494980  56256  40944 S  35.9  2.8   0:13.02 apache2
 2898 www-data  20   0  493360  46648  32980 R  34.2  2.3   0:25.21 apache2
 3044 www-data  20   0  491528  28824  17472 S  34.2  1.4   0:13.69 apache2
Member

enoch85 commented Aug 4, 2015

@ghiamar Just as a reference:

Client
1.8.4

Server
ownCloud Version: 8.1.0-3
Ubuntu Server 14.04
Apache/2.4.7
PHP 5.5.9
libmysql - 5.5.44

HDDs on server
WD Red (NAS edition) RAID1

Testfiles
https://www.en0ch.se/stress-test/

Time to complete sync
Start Time - End Time:
23:53:37 - 23:59:00 (About 6 minutes)

Network
(LAN) 100 Mbit/s down / 100 Mbit/s up

Top

load average: 1.34, 0.89, 0.41
Tasks: 272 total,   2 running, 270 sleeping,   0 stopped,   0 zombie
%Cpu(s): 11.1 us,  5.8 sy,  0.0 ni, 60.1 id,  6.1 wa,  0.0 hi, 16.9 si,  0.0 st
KiB Mem:   2043140 total,  1977136 used,    66004 free,   137888 buffers
KiB Swap:        0 total,        0 used,        0 free.  1120100 cached Mem

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
 1314 mysql     20   0 1140928 113416   7732 S  52.2  5.6   2:36.22 mysqld
 3046 www-data  20   0  494980  56256  40944 S  35.9  2.8   0:13.02 apache2
 2898 www-data  20   0  493360  46648  32980 R  34.2  2.3   0:25.21 apache2
 3044 www-data  20   0  491528  28824  17472 S  34.2  1.4   0:13.69 apache2
@mgscreativa

This comment has been minimized.

Show comment
Hide comment
@mgscreativa

mgscreativa Aug 4, 2015

Hi, it seems that in my case the most consuming process is the PHP interpreter.

Just to mention, copying the very same folder to a shared folder in the very same server it took 40 second to copy!

Client
1.8.4-1

Server
ownCloud Version: 8.1.0.8
Ubuntu 14.04.3 LTS
Apache/2.4.7
PHP 5.5.9-1ubuntu4.11
libmysql 5.5.44

HDDs on server
WD Green (software RAID1 with mdadm)

Testfiles
https://www.en0ch.se/stress-test/

Time to complete sync
Ridiculously 2h 11m remaining...

Network
(LAN) 1000 Mbit/s down / 1000 Mbit/s up

Top

top - 19:44:08 up  3:04,  1 user,  load average: 3,10, 2,74, 1,63
Tareas: 195 total,   3 ejecutar,  192 hibernar,    0 detener,    0 zombie
%Cpu(s): 14,6 usuario,  2,0 sist,  0,0 adecuado, 75,7 inact,  7,7 en espera,  0
KiB Mem:   8168072 total,  7980956 used,   187116 free,   592968 buffers
KiB Swap:  6028284 total,        0 used,  6028284 free.  6000380 cached Mem

  PID USUARIO   PR  NI    VIRT    RES    SHR S  %CPU %MEM     HORA+ ORDEN      
16500 web2      20   0  830092  59676  40288 S  30,9  0,7   0:00.93 php-cgi    
16501 web2      20   0  528592  53848  36752 S  28,2  0,7   0:00.85 php-cgi    
16504 web2      20   0  516072  34284  22724 R   8,3  0,4   0:00.25 php-cgi    
16505 web2      20   0  515788  32968  21864 R   7,3  0,4   0:00.22 php-cgi    
 1457 mysql     20   0 1273144 314916   7796 S   3,7  3,9   1:35.15 mysqld 

Hi, it seems that in my case the most consuming process is the PHP interpreter.

Just to mention, copying the very same folder to a shared folder in the very same server it took 40 second to copy!

Client
1.8.4-1

Server
ownCloud Version: 8.1.0.8
Ubuntu 14.04.3 LTS
Apache/2.4.7
PHP 5.5.9-1ubuntu4.11
libmysql 5.5.44

HDDs on server
WD Green (software RAID1 with mdadm)

Testfiles
https://www.en0ch.se/stress-test/

Time to complete sync
Ridiculously 2h 11m remaining...

Network
(LAN) 1000 Mbit/s down / 1000 Mbit/s up

Top

top - 19:44:08 up  3:04,  1 user,  load average: 3,10, 2,74, 1,63
Tareas: 195 total,   3 ejecutar,  192 hibernar,    0 detener,    0 zombie
%Cpu(s): 14,6 usuario,  2,0 sist,  0,0 adecuado, 75,7 inact,  7,7 en espera,  0
KiB Mem:   8168072 total,  7980956 used,   187116 free,   592968 buffers
KiB Swap:  6028284 total,        0 used,  6028284 free.  6000380 cached Mem

  PID USUARIO   PR  NI    VIRT    RES    SHR S  %CPU %MEM     HORA+ ORDEN      
16500 web2      20   0  830092  59676  40288 S  30,9  0,7   0:00.93 php-cgi    
16501 web2      20   0  528592  53848  36752 S  28,2  0,7   0:00.85 php-cgi    
16504 web2      20   0  516072  34284  22724 R   8,3  0,4   0:00.25 php-cgi    
16505 web2      20   0  515788  32968  21864 R   7,3  0,4   0:00.22 php-cgi    
 1457 mysql     20   0 1273144 314916   7796 S   3,7  3,9   1:35.15 mysqld 
@enoch85

This comment has been minimized.

Show comment
Hide comment
@enoch85

enoch85 Aug 4, 2015

Member

@ghiamar I can see in your processes that you use PHP-CGI, and mine says Apache2.

Just a quick google on the issue:

"Executing PHP scripts with a CGI application is the legacy way of running applications on a web server, it’s highly inefficient and rarely used. It was originally introduced in the 1990’s but was deemed to be too inefficient to use on anything other than very small sites... / ...The inefficiencies of running PHP with CGI support spawn from requiring a new process to be created each time any PHP code needs to be executed. As you can imagine, on busier sites or PHP based applications it can be very resource intensive." http://blog.layershift.com/which-php-mode-apache-vs-cgi-vs-fastcgi/

Also, look at your load VS my load.

Maybe that explains it?

Just to give a fair test I uploaded the files to a remote server, and yes - it took a while longer. But still under 10 minutes. That server also uses Apache2 without the CGI stuff.

Member

enoch85 commented Aug 4, 2015

@ghiamar I can see in your processes that you use PHP-CGI, and mine says Apache2.

Just a quick google on the issue:

"Executing PHP scripts with a CGI application is the legacy way of running applications on a web server, it’s highly inefficient and rarely used. It was originally introduced in the 1990’s but was deemed to be too inefficient to use on anything other than very small sites... / ...The inefficiencies of running PHP with CGI support spawn from requiring a new process to be created each time any PHP code needs to be executed. As you can imagine, on busier sites or PHP based applications it can be very resource intensive." http://blog.layershift.com/which-php-mode-apache-vs-cgi-vs-fastcgi/

Also, look at your load VS my load.

Maybe that explains it?

Just to give a fair test I uploaded the files to a remote server, and yes - it took a while longer. But still under 10 minutes. That server also uses Apache2 without the CGI stuff.

@guruz

This comment has been minimized.

Show comment
Hide comment
@guruz

guruz Aug 5, 2015

Contributor

btw, Some unofficial top secret numbers by @jturcotte and @LukasReschke

benchmark

Contributor

guruz commented Aug 5, 2015

btw, Some unofficial top secret numbers by @jturcotte and @LukasReschke

benchmark

@mgscreativa

This comment has been minimized.

Show comment
Hide comment
@mgscreativa

mgscreativa Aug 5, 2015

Well I have setup the server to run php as FastCGI (Server API CGI/FastCGI )

Anyway, in the pursuit of performance I hit this cache article https://owncloud.org/blog/making-owncloud-faster-through-caching/ so I went ahead and run a set of commands:

sudo apt-get --purge remove php5-xcache (I had xcache enabled)
cd /tmp
sudo wget http://mirrors.kernel.org/ubuntu/pool/universe/p/php-apcu/php5-apcu_4.0.6-1_amd64.deb
sudo dpkg -i php5-apcu_4.0.6-1_amd64.deb
sudo rm php5-apcu_4.0.6-1_amd64.deb

Then I enabled APCu for the OC instance only on a individual php.ini file (yes I'm a bit paranoid):

[APCu]
extension=apcu.so
apc.enabled=On
apc.enable_cli=On

And finally I set this configuration option in owncloud 'memcache.local' => '\OC\Memcache\APCu',

Now you can see the resource consumption decrease and but sync speed remains tha same!...

top - 10:48:03 up  2:51,  1 user,  load average: 2,33, 2,34, 2,32
Tareas: 194 total,   2 ejecutar,  192 hibernar,    0 detener,    0 zombie
%Cpu(s):  1,5 usuario,  0,5 sist,  0,0 adecuado, 88,5 inact,  9,6 en espera,  0
KiB Mem:   8168072 total,  6067888 used,  2100184 free,   417388 buffers
KiB Swap:  6028284 total,        0 used,  6028284 free.  4241992 cached Mem

  PID USUARIO   PR  NI    VIRT    RES    SHR S  %CPU %MEM     HORA+ ORDEN      
 1495 mysql     20   0 1412416 315512   7556 S   4,0  3,9   4:42.07 mysqld     
29502 web2      20   0  791948  44972  30776 S   3,7  0,6   0:00.60 php-cgi    
29504 web2      20   0  492144  38788  27352 R   1,0  0,5   0:00.48 php-cgi    
    7 root      20   0       0      0      0 S   0,3  0,0   0:23.92 rcu_sched  
   39 root      20   0       0      0      0 S   0,3  0,0   0:00.10 ksoftirqd/3
  431 root      20   0       0      0      0 D   0,3  0,0   0:12.81 jbd2/md0-8 
 2848 root      20   0  707956  12284   2796 S   0,3  0,2   0:14.62 fail2ban-s+
19681 root       0 -20       0      0      0 S   0,3  0,0   0:07.04 kworker/u1+
25682 root       0 -20       0      0      0 S   0,3  0,0   0:05.04 kworker/u1+
29506 web2      20   0  492176  38732  27244 S   0,3  0,5   0:00.48 php-cgi    
    1 root      20   0   33896   3224   1472 S   0,0  0,0   0:02.04 init       
    2 root      20   0       0      0      0 S   0,0  0,0   0:00.00 kthreadd   
    3 root      20   0       0      0      0 S   0,0  0,0   0:00.08 ksoftirqd/0
    4 root      20   0       0      0      0 S   0,0  0,0   0:00.00 kworker/0:0
    5 root       0 -20       0      0      0 S   0,0  0,0   0:00.00 kworker/0:+
    8 root      20   0       0      0      0 S   0,0  0,0   0:06.19 rcuos/0    
    9 root      20   0       0      0      0 S   0,0  0,0   0:03.99 rcuos/1 

Well I have setup the server to run php as FastCGI (Server API CGI/FastCGI )

Anyway, in the pursuit of performance I hit this cache article https://owncloud.org/blog/making-owncloud-faster-through-caching/ so I went ahead and run a set of commands:

sudo apt-get --purge remove php5-xcache (I had xcache enabled)
cd /tmp
sudo wget http://mirrors.kernel.org/ubuntu/pool/universe/p/php-apcu/php5-apcu_4.0.6-1_amd64.deb
sudo dpkg -i php5-apcu_4.0.6-1_amd64.deb
sudo rm php5-apcu_4.0.6-1_amd64.deb

Then I enabled APCu for the OC instance only on a individual php.ini file (yes I'm a bit paranoid):

[APCu]
extension=apcu.so
apc.enabled=On
apc.enable_cli=On

And finally I set this configuration option in owncloud 'memcache.local' => '\OC\Memcache\APCu',

Now you can see the resource consumption decrease and but sync speed remains tha same!...

top - 10:48:03 up  2:51,  1 user,  load average: 2,33, 2,34, 2,32
Tareas: 194 total,   2 ejecutar,  192 hibernar,    0 detener,    0 zombie
%Cpu(s):  1,5 usuario,  0,5 sist,  0,0 adecuado, 88,5 inact,  9,6 en espera,  0
KiB Mem:   8168072 total,  6067888 used,  2100184 free,   417388 buffers
KiB Swap:  6028284 total,        0 used,  6028284 free.  4241992 cached Mem

  PID USUARIO   PR  NI    VIRT    RES    SHR S  %CPU %MEM     HORA+ ORDEN      
 1495 mysql     20   0 1412416 315512   7556 S   4,0  3,9   4:42.07 mysqld     
29502 web2      20   0  791948  44972  30776 S   3,7  0,6   0:00.60 php-cgi    
29504 web2      20   0  492144  38788  27352 R   1,0  0,5   0:00.48 php-cgi    
    7 root      20   0       0      0      0 S   0,3  0,0   0:23.92 rcu_sched  
   39 root      20   0       0      0      0 S   0,3  0,0   0:00.10 ksoftirqd/3
  431 root      20   0       0      0      0 D   0,3  0,0   0:12.81 jbd2/md0-8 
 2848 root      20   0  707956  12284   2796 S   0,3  0,2   0:14.62 fail2ban-s+
19681 root       0 -20       0      0      0 S   0,3  0,0   0:07.04 kworker/u1+
25682 root       0 -20       0      0      0 S   0,3  0,0   0:05.04 kworker/u1+
29506 web2      20   0  492176  38732  27244 S   0,3  0,5   0:00.48 php-cgi    
    1 root      20   0   33896   3224   1472 S   0,0  0,0   0:02.04 init       
    2 root      20   0       0      0      0 S   0,0  0,0   0:00.00 kthreadd   
    3 root      20   0       0      0      0 S   0,0  0,0   0:00.08 ksoftirqd/0
    4 root      20   0       0      0      0 S   0,0  0,0   0:00.00 kworker/0:0
    5 root       0 -20       0      0      0 S   0,0  0,0   0:00.00 kworker/0:+
    8 root      20   0       0      0      0 S   0,0  0,0   0:06.19 rcuos/0    
    9 root      20   0       0      0      0 S   0,0  0,0   0:03.99 rcuos/1 
@Tralapo

This comment has been minimized.

Show comment
Hide comment
@Tralapo

Tralapo Oct 6, 2015

I see this (old) issue is closed, but I still have this problem. Installed ownCloud fresh. My setup:

Server

RaspberryPi 2 Model B
ownCloud 8.1.3
Nginx 1.9.5
MySQL 5.5.44
Encryption on

Desktop

Windows 10
Latest client 2.0.1

To be fair: yes, it's a Pi, hooked up to a external hard drive, so I didn't expect lightning speed. But: larger files and folders upload very fast, faster then I had expected.

I used Dropbox to store my websites/git projects, and would like to move that over to ownCloud. But syncing gives me a pain. For example a WordPress folder, takes ages. Sometimes up to 10 seconds for a file a few kB in size:

knipsel

I started uploading these projects folder for folder or even sub-folder for sub-folder, because the connection will just close if I copy my entire website over to ownCloud at once (tried that). It seems to stay alive now while doing it in pieces. Could, of course, be that the Pi dies when I throw everything at once at it, so I'm fine with that.

But it takes me hours to only sync the /wp-includes/ folder of WordPress?! While it syncs folders with a lot of Word-files and 7z-folders in minutes or even seconds. So I can't blame everything on the Pi being slow.

This issue is closed, but my issue seems to be the same? Also: when a upload fails, it fails completely. Connection time-outs, the sync-program tries to download things it should upload with a time-out directly afterwards. Have to delete the files from the web interface and on Windows to 'reset' it.

Tralapo commented Oct 6, 2015

I see this (old) issue is closed, but I still have this problem. Installed ownCloud fresh. My setup:

Server

RaspberryPi 2 Model B
ownCloud 8.1.3
Nginx 1.9.5
MySQL 5.5.44
Encryption on

Desktop

Windows 10
Latest client 2.0.1

To be fair: yes, it's a Pi, hooked up to a external hard drive, so I didn't expect lightning speed. But: larger files and folders upload very fast, faster then I had expected.

I used Dropbox to store my websites/git projects, and would like to move that over to ownCloud. But syncing gives me a pain. For example a WordPress folder, takes ages. Sometimes up to 10 seconds for a file a few kB in size:

knipsel

I started uploading these projects folder for folder or even sub-folder for sub-folder, because the connection will just close if I copy my entire website over to ownCloud at once (tried that). It seems to stay alive now while doing it in pieces. Could, of course, be that the Pi dies when I throw everything at once at it, so I'm fine with that.

But it takes me hours to only sync the /wp-includes/ folder of WordPress?! While it syncs folders with a lot of Word-files and 7z-folders in minutes or even seconds. So I can't blame everything on the Pi being slow.

This issue is closed, but my issue seems to be the same? Also: when a upload fails, it fails completely. Connection time-outs, the sync-program tries to download things it should upload with a time-out directly afterwards. Have to delete the files from the web interface and on Windows to 'reset' it.

@batamire

This comment has been minimized.

Show comment
Hide comment
@enoch85

This comment has been minimized.

Show comment
Hide comment
@enoch85

enoch85 Oct 9, 2015

Member

@Tralapo @batamire I just tested to sync the Stress Test package with 10 300 files of 3 b each, and it took me 8 minutes with 2.0.2 testpilot version: https://download.owncloud.com/desktop/daily/testpilotcloud-2.0.2.5525-nightly20151008-setup.exe

Package: https://www.en0ch.se/stress-test/

Look in previous comments for server setup. Now using server 8.1.3 and PHP 5.6

Member

enoch85 commented Oct 9, 2015

@Tralapo @batamire I just tested to sync the Stress Test package with 10 300 files of 3 b each, and it took me 8 minutes with 2.0.2 testpilot version: https://download.owncloud.com/desktop/daily/testpilotcloud-2.0.2.5525-nightly20151008-setup.exe

Package: https://www.en0ch.se/stress-test/

Look in previous comments for server setup. Now using server 8.1.3 and PHP 5.6

@Tralapo

This comment has been minimized.

Show comment
Hide comment
@Tralapo

Tralapo Oct 9, 2015

@enoch85 Thanks for the tip. I installed the 2.0.2 Testpilot and it indeed seems to perform a lot better then 2.0.1. I don't get the stress test done in 8 minutes, it expects around 8-10 hours. But that's because of the hardware (RaspberryPi) I would say. The 2.0.1. gives me a expectation of several days(!), so an improvement for sure.

Stable:
stable

Beta:
beta

Tralapo commented Oct 9, 2015

@enoch85 Thanks for the tip. I installed the 2.0.2 Testpilot and it indeed seems to perform a lot better then 2.0.1. I don't get the stress test done in 8 minutes, it expects around 8-10 hours. But that's because of the hardware (RaspberryPi) I would say. The 2.0.1. gives me a expectation of several days(!), so an improvement for sure.

Stable:
stable

Beta:
beta

@enoch85

This comment has been minimized.

Show comment
Hide comment
@enoch85

enoch85 Oct 9, 2015

Member

For future testing, here are the latest daily builds: https://download.owncloud.com/desktop/daily/

Member

enoch85 commented Oct 9, 2015

For future testing, here are the latest daily builds: https://download.owncloud.com/desktop/daily/

@ApolloLV

This comment has been minimized.

Show comment
Hide comment
@ApolloLV

ApolloLV Feb 4, 2016

Using Desktop App 2.1.0 and Owncloud 8.2.2 on a Ubuntu 14.04 LTS Server running on my Cubietruck, backend is MYSQL 5.5.47. I am using APCu and static assets with Apache 2.4.7 and PHP 5.5.9. I now get 2 days!!! for 92 MBs in 4370 files. The Sync activity does not even bottleneck anything. The Network connection is wifi and the machines are in the same network. The HDD is directly accessed via SATA. The only possible bottleneck is the CPU, it experiences spikes for some seconds and then goes back to idling for several seconds.
What could be wrong?

ApolloLV commented Feb 4, 2016

Using Desktop App 2.1.0 and Owncloud 8.2.2 on a Ubuntu 14.04 LTS Server running on my Cubietruck, backend is MYSQL 5.5.47. I am using APCu and static assets with Apache 2.4.7 and PHP 5.5.9. I now get 2 days!!! for 92 MBs in 4370 files. The Sync activity does not even bottleneck anything. The Network connection is wifi and the machines are in the same network. The HDD is directly accessed via SATA. The only possible bottleneck is the CPU, it experiences spikes for some seconds and then goes back to idling for several seconds.
What could be wrong?

@Traiden

This comment has been minimized.

Show comment
Hide comment
@Traiden

Traiden Feb 9, 2016

I increased a lot my speed with this methode, but I don't understand really. Somebody can explain to me please?

http://forum.owncloud.org/viewtopic.php?f=3&t=6621#p14737

Thank you!

Traiden commented Feb 9, 2016

I increased a lot my speed with this methode, but I don't understand really. Somebody can explain to me please?

http://forum.owncloud.org/viewtopic.php?f=3&t=6621#p14737

Thank you!

@mgscreativa

This comment has been minimized.

Show comment
Hide comment
@mgscreativa

mgscreativa Mar 24, 2016

Hi! I have installed php 7.0.4 on my home server because all the praises about being fast. I installed it on my Ubuntu Server 14.04.4 LTS with ispConfig. The installation went just fine, and I also managed to enable PHP-FPM 7.0.4 on an apache virtual host subfolder only (yes, I have php 5.5.9 on virtualhost and in /cloud subfolder PHP 7.0.4 FPM) . Despite of this, my OC 2.1.1 sync client tells me that the sync of the stress test files will take above 3 hours!

Copying the stress test files through CIFS to my server takes about 3 to 5 minutes, maybe less.

This is not the first time I try to tackle this issue so I have prepared a very detailed bug report for @enoch85, @ApolloLV, @gluap, @PVince81 and @guruz so they can take a look at it. For you guys, basically I was able to setup PHP 7.0.4 with PHP-FPM on apache 2.4 virtualhost subfolder and seems to be woking right, I was also able to setup APCu 5.1.3 and seems to be caching ok (see details of apcu stats). Maybe you can take a look at my PHP-FPM pool config to optimize it a bit.

I have to mention that my sync client seems to sync 3 files then do a little sleep and then another 3 files, and so on...¿¿??

That being said, lets start to report this bug (or enhancement, as you like)...

Steps to reproduce

  1. On Ubuntu Server 14.04 Install PHP 7.0.4 following this guide https://www.howtoforge.com/tutorial/how-to-install-php-7-on-debian/#comments
  2. Enable PHP-FPM through ispConfig CP to enable it on web server
  3. Install APCu 5.1.3 with this command /opt/php-7.0.4/bin./pecl install channel://pecl.php.net/apcu-5.1.3
  4. Enable memcache in OwnCloud server config file
  5. Enable APCu extension=apcu.so in main php.ini file /opt/php-7.0.4/lib/php.ini
  6. Follow apache optimization guide here https://doc.owncloud.org/server/9.0/admin_manual/configuration_server/performance_tuning/webserver_tips.html#apache-tuning
  7. On the client side install latest OwnCloud Client (2.1.1)
  8. Put to sync the uncompressed stress test package

Expected behaviour

I expected that the sync will last less time!

Actual behaviour

The sync process is very slow!

Server configuration

Operating system: Ubuntu Server 14.04.4 LTS (Linux lucas 3.13.0-83-generic #127-Ubuntu SMP Fri Mar 11 00:25:37 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux)

Web server: Server version: Apache/2.4.7 (Ubuntu) - Server built: Jan 14 2016 17:45:23

Database: MySQL 5.5.47-0ubuntu0.14.04.1

PHP version: 7.0.4 (Server API: FPM/FastCGI)

ownCloud version: 9.0

Updated from an older ownCloud or fresh install: Updated from an older ownCloud

Where did you install ownCloud from: Manual Install

Apache virtual host PHP-FPM config:

#PHP-FPM
<IfModule mod_fastcgi.c>
    KeepAlive On
    KeepAliveTimeout 100
    MaxKeepAliveRequests 200

    <IfModule mod_headers.c>
      Header always set Strict-Transport-Security "max-age=15768000; includeSubDomains; preload"
    </IfModule>

    <Directory /var/www/it.mga.com/web/cloud>
        HostnameLookups Off   
        <FilesMatch "\.php[345]?$">
            SetHandler php7-fcgi
        </FilesMatch>
    </Directory>

    <Directory /var/XXX/clients/XXX/XXX/web/cloud/>
        HostnameLookups Off   
        <FilesMatch "\.php[345]?$">
            SetHandler php7-fcgi
        </FilesMatch>
    </Directory>

    <LocationMatch "/cloud/(fpm-ping|fpm-status)">
        HostnameLookups Off    
        SetHandler php7-fcgi-virt
        Action php7-fcgi-virt /php7-fcgi virtual
    </LocationMatch>

    Action php7-fcgi /php7-fcgi
    Alias /php7-fcgi /var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com
    FastCgiExternalServer /var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com -idle-timeout 300 -socket /var/lib/php5-fpm/XXX-cloud.sock -pass-header Authorization
</IfModule>

<IfModule mod_proxy_fcgi.c>
    ProxyPassMatch ^/(.*\.php[345]?(/.*)?)$ fcgi://127.0.0.1:9011/var/XXX/clients/XXX/XXX/web/cloud/$1
</IfModule>

PHP-FPM pool config:

[XXX-cloud]

listen = /var/lib/php5-fpm/XXX-cloud.sock
listen.allowed_clients = 127.0.0.1
listen.owner = XXX
listen.group = XXX
listen.mode = 0660
listen.backlog = 4096

user = XXX
group = XXX

;request_slowlog_timeout = 5s
;slowlog = '/var/XXX/clients/XXX/XXX/tmp/phplogs/php_cloud_fpm_slow.log'

request_terminate_timeout = 120s
rlimit_files = 131072
rlimit_core = unlimited
catch_workers_output = yes

pm = dynamic
pm.max_children = 10
pm.start_servers = 3
pm.min_spare_servers = 2
pm.max_spare_servers = 4
pm.max_requests = 400
pm.status_path = /cloud/fpm-status
ping.path = /cloud/fpm-ping
ping.response = 'Pong: *** XXX-cloud ***'

;chroot = '/var/XXX/clients/XXX/XXX/web/cloud/'
;chdir = /

; PHP Environment Variables Overrides
env[TMP] = '/var/XXX/clients/XXX/XXX/tmp'
env[TMPDIR] = '/var/XXX/clients/XXX/XXX/tmp'
env[TEMP] = '/var/XXX/clients/XXX/XXX/tmp'
env[PHP_DOCUMENT_ROOT] = '/var/XXX/clients/XXX/XXX/web/cloud'

; php.ini Overrides
php_admin_value[sendmail_path] = '/usr/sbin/sendmail -t -i -fwebmaster@it.mga.com'
php_admin_value[open_basedir] = '/var/XXX/clients/XXX/XXX/web/cloud:/var/XXX/clients/XXX/XXX/private:/var/XXX/clients/XXX/XXX/tmp:/var/www/it.mga.com/web/cloud:/srv/www/it.mga.com/web/cloud:/usr/share/php5:/usr/share/php:/tmp:/usr/share/phpmyadmin:/etc/phpmyadmin:/var/lib/phpmyadmin:/dev/urandom'
php_admin_value[session.save_path] = '/var/XXX/clients/XXX/XXX/tmp'
php_admin_value[upload_tmp_dir] = '/var/XXX/clients/XXX/XXX/tmp'
php_admin_value[disable_functions] = 'XXX,XXX,XXX'
php_admin_value[upload_max_filesize] = 1024M
php_admin_value[post_max_size] = 1024M
php_admin_value[memory_limit] = 1024M
php_admin_flag[mbstring.func_overload] = Off
php_admin_value[default_charset] = 'UTF-8'
php_admin_flag[output_buffering] = Off
php_admin_value[max_execution_time] = 6000
php_admin_flag[short_open_tag] = Off
php_admin_value[date.timezone] = 'America/XXX/XXX'
php_admin_flag[display_errors] = Off
php_admin_flag[html_errors] = Off
php_admin_value[error_reporting] = E_ALL
php_admin_flag[log_errors] = On
php_admin_value[error_log] = '/var/XXX/clients/XXX/XXX/tmp/phplogs/php_cloud.log'
php_admin_flag[expose_php] = Off

APCu 5.1.3 stats:

General Cache Information
APCu Version    5.1.3
PHP Version 7.0.4
APCu Host   it.mga.com (lucas) (192.168.1.77)
Server Software Apache/2.4.7 (Ubuntu)
Shared Memory   1 Segment(s) with 32.0 MBytes (mmap memory)
Start Time  2016/03/24 17:05:51
Uptime  1 hour and 13 minutes

Cache Information
Cached Variables    372 (250.0 KBytes)
Hits    1033293
Misses  17093
Request Rate (hits, misses) 239.54 cache requests/second
Hit Rate    235.64 cache requests/second
Miss Rate   3.90 cache requests/second
Insert Rate 3.90 cache requests/second
Cache full count    0

Runtime Settings
apc.coredump_unmap  0
apc.enable_cli  
apc.enabled 1
apc.entries_hint    4096
apc.gc_ttl  3600
apc.mmap_file_mask  
apc.preload_path    
apc.serializer  php
apc.shm_segments    1
apc.shm_size    32M
apc.slam_defense    1
apc.smart   0
apc.ttl 0
apc.use_request_time    1
apc.writable    /tmp

Server hardware

CPU: Intel(R) Core(TM) i7 860 @ 2.80GHz

Motherboard: Gigabyte P55M-UD2

RAM: 12GB 1333 MHz

Server System HDDs: SSD Samsung 840 120Gb

Server Storage HDDs: 2x WD Green WD20EARX 2TB (software RAID1 with mdadm)

Network: (LAN) 1000 Mbit/s down / 1000 Mbit/s up

Stress Test Info

Stress Test Files: https://www.en0ch.se/stress-test/

Client: 2.1.1

Top:

top - 17:25:49 up  3:26,  2 users,  load average: 2,68, 2,47, 2,36
Tareas: 225 total,   3 ejecutar,  222 hibernar,    0 detener,    0 zombie
%Cpu(s):  5,8 usuario,  3,3 sist,  0,0 adecuado, 80,6 inact,  9,9 en espera,  0,
KiB Mem:  12296816 total, 12149720 used,   147096 free,   193332 buffers
KiB Swap:        0 total,        0 used,        0 free. 10387584 cached Mem

  PID USUARIO   PR  NI    VIRT    RES    SHR S  %CPU %MEM     HORA+ ORDEN       
13827 web2      20   0  197296  21948   5596 S  17,9  0,2   0:59.61 php-fpm     
13739 web2      20   0  197292  21908   5556 R  11,6  0,2   1:03.46 php-fpm     
13857 web2      20   0  274888  25812   7424 S  10,6  0,2   0:35.13 php-fpm     
13826 web2      20   0  197296  21908   5556 S  10,0  0,2   0:49.06 php-fpm     
13740 web2      20   0  197292  21936   5636 S   9,3  0,2   1:12.93 php-fpm 

Signing status (ownCloud 9.0 and above):

No errors have been found.

List of activated apps:

Enabled:
  - activity: 2.2.1
  - comments: 0.2
  - dav: 0.1.5
  - federatedfilesharing: 0.1.0
  - federation: 0.0.4
  - files: 1.4.4
  - files_pdfviewer: 0.8
  - files_sharing: 0.9.1
  - files_texteditor: 2.1
  - files_trashbin: 0.8.0
  - files_versions: 1.2.0
  - files_videoplayer: 0.9.8
  - firstrunwizard: 1.1
  - gallery: 14.5.0
  - notifications: 0.2.3
  - provisioning_api: 0.4.1
  - systemtags: 0.2
  - templateeditor: 0.1
  - updatenotification: 0.1.0
Disabled:
  - encryption
  - external
  - files_external
  - user_external
  - user_ldap

The content of config/config.php:

list system
{
    "system": {
        "instanceid": "ocl00gp133cg",
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": [
            "it.mga.com"
        ],
        "datadirectory": "\/var\/XXX\/clients\/XXX\/XXX\/web\/cloud\/data",
        "overwrite.cli.url": "https:\/\/it.mga.com\/cloud",
        "dbtype": "mysql",
        "version": "9.0.0.19",
        "dbname": "c1_cloud",
        "dbhost": "127.0.0.1",
        "dbtableprefix": "oc_",
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "logtimezone": "America\/Argentina\/Buenos_Aires",
        "installed": true,
        "forcessl": true,
        "theme": "",
        "maintenance": false,
        "mail_from_address": "martinb",
        "mail_smtpmode": "php",
        "mail_domain": "mga.com",
        "memcache.local": "\\OC\\Memcache\\APCu",
        "loglevel": 1,
        "trashbin_retention_obligation": "auto"
    }
}

Are you using external storage, if yes which one: Nope

Are you using encryption: no

Are you using an external user-backend, if yes which one: Nope

Client configuration

Browser: Firefox 45.0

Operating system: Ubuntu 16.10

Logs

Web server error log

[Thu Mar 24 16:05:11.397590 2016] [:error] [pid 8713] [client 192.168.1.2:39136] FastCGI: server "/var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com" stderr: Primary script unknown
[Thu Mar 24 16:05:13.857488 2016] [:error] [pid 8713] [client 192.168.1.2:39136] FastCGI: server "/var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com" stderr: Primary script unknown
[Thu Mar 24 16:05:13.897382 2016] [:error] [pid 8713] [client 192.168.1.2:39136] FastCGI: server "/var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com" stderr: Primary script unknown
[Thu Mar 24 16:05:23.729197 2016] [:error] [pid 8713] [client 192.168.1.2:39136] FastCGI: server "/var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com" stderr: Primary script unknown
[Thu Mar 24 16:05:28.773171 2016] [:error] [pid 8713] [client 192.168.1.2:39136] FastCGI: server "/var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com" stderr: Primary script unknown
[Thu Mar 24 16:05:33.817182 2016] [:error] [pid 8713] [client 192.168.1.2:39136] FastCGI: server "/var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com" stderr: Primary script unknown
[Thu Mar 24 16:05:33.838210 2016] [:error] [pid 8598] [client 192.168.1.2:39140] FastCGI: server "/var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com" stderr: Primary script unknown
[Thu Mar 24 16:05:38.861196 2016] [:error] [pid 8713] [client 192.168.1.2:39136] FastCGI: server "/var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com" stderr: Primary script unknown
[Thu Mar 24 16:05:40.817157 2016] [:error] [pid 8713] [client 192.168.1.2:39136] FastCGI: server "/var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com" stderr: Primary script unknown
[Thu Mar 24 16:06:12.785681 2016] [:error] [pid 8713] [client 192.168.1.2:39136] FastCGI: server "/var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com" stderr: Primary script unknown
[Thu Mar 24 16:06:12.789222 2016] [:error] [pid 8713] [client 192.168.1.2:39136] FastCGI: server "/var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com" stderr: Primary script unknown
[Thu Mar 24 16:31:08.858862 2016] [fastcgi:error] [pid 10480] (104)Connection reset by peer: [client 192.168.1.2:39306] FastCGI: comm with server "/var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com" aborted: read failed
[Thu Mar 24 16:31:08.858949 2016] [fastcgi:error] [pid 10480] [client 192.168.1.2:39306] FastCGI: incomplete headers (0 bytes) received from server "/var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com"

ownCloud log (data/owncloud.log)

eqId":"yKsUAo6Olzfy0HP+dx3Z","remoteAddr":"192.168.1.2","app":"core","message":"Login failed: 'apc' (Remote IP: '192.168.1.2')","level":2,"time":"2016-03-24T19:18:41+00:00"}
{"reqId":"BFdB08p0dkI7GAQc2Z7Z","remoteAddr":"192.168.1.2","app":"no app in context","message":"Exception: {\"Exception\":\"OCP\\\\Files\\\\NotFoundException\",\"Message\":\"\\\/soft\\\/Programas\\\/iso2usb\\\/tuxboot-0.8.3.exe not found while trying to get owner\",\"Code\":0,\"Trace\":\"#0 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/files\\\/filesystem.php(913): OC\\\\Files\\\\View->getOwner('\\\/soft\\\/Programas...')\\n#1 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(191): OC\\\\Files\\\\Filesystem::getOwner('\\\/soft\\\/Programas...')\\n#2 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(145): OCA\\\\Activity\\\\FilesHooks->getSourcePathAndOwner('\\\/soft\\\/Programas...')\\n#3 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(101): OCA\\\\Activity\\\\FilesHooks->addNotificationsForFileAction('\\\/soft\\\/Programas...', 'file_created', 'created_self', 'created_by')\\n#4 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooksstatic.php(60): OCA\\\\Activity\\\\FilesHooks->fileCreate('\\\/soft\\\/Programas...')\\n#5 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/hook.php(105): OCA\\\\Activity\\\\FilesHooksStatic::fileCreate(Array)\\n#6 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/filechunking.php(223): OC_Hook::emit('OC_Filesystem', 'post_create', Array)\\n#7 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/file.php(436): OC_FileChunking->file_assemble(Object(OCA\\\\Files_Trashbin\\\\Storage), 'files\\\/soft\\\/Prog...', '\\\/martinb\\\/files\\\/...')\\n#8 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/file.php(103): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->createFileChunked(Resource id #328)\\n#9 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/directory.php(134): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->put(Resource id #328)\\n#10 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(1036): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\Directory->createFile('tuxboot-0.8.3.e...', Resource id #328)\\n#11 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/CorePlugin.php(525): Sabre\\\\DAV\\\\Server->createFile('soft\\\/Programas\\\/...', Resource id #328, NULL)\\n#12 [internal function]: Sabre\\\\DAV\\\\CorePlugin->httpPut(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#13 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/event\\\/lib\\\/EventEmitterTrait.php(105): call_user_func_array(Array, Array)\\n#14 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(459): Sabre\\\\Event\\\\EventEmitter->emit('method:PUT', Array)\\n#15 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(248): Sabre\\\\DAV\\\\Server->invokeMethod(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#16 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/appinfo\\\/v1\\\/webdav.php(55): Sabre\\\\DAV\\\\Server->exec()\\n#17 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/remote.php(138): require_once('\\\/var\\\/www\\\/client...')\\n#18 {main}\",\"File\":\"\\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/files\\\/view.php\",\"Line\":1583}","level":3,"time":"2016-03-24T19:19:27+00:00"}
{"reqId":"IHfPmO1eM6+12tCntmmF","remoteAddr":"192.168.1.2","app":"no app in context","message":"Exception: {\"Exception\":\"OCP\\\\Files\\\\NotFoundException\",\"Message\":\"\\\/soft\\\/Programas\\\/joomla\\\/core\\\/3.4\\\/3.4.3\\\/Joomla_3.4.3-Stable-Full_Package.zip not found while trying to get owner\",\"Code\":0,\"Trace\":\"#0 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/files\\\/filesystem.php(913): OC\\\\Files\\\\View->getOwner('\\\/soft\\\/Programas...')\\n#1 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(191): OC\\\\Files\\\\Filesystem::getOwner('\\\/soft\\\/Programas...')\\n#2 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(145): OCA\\\\Activity\\\\FilesHooks->getSourcePathAndOwner('\\\/soft\\\/Programas...')\\n#3 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(101): OCA\\\\Activity\\\\FilesHooks->addNotificationsForFileAction('\\\/soft\\\/Programas...', 'file_created', 'created_self', 'created_by')\\n#4 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooksstatic.php(60): OCA\\\\Activity\\\\FilesHooks->fileCreate('\\\/soft\\\/Programas...')\\n#5 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/hook.php(105): OCA\\\\Activity\\\\FilesHooksStatic::fileCreate(Array)\\n#6 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/filechunking.php(223): OC_Hook::emit('OC_Filesystem', 'post_create', Array)\\n#7 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/file.php(436): OC_FileChunking->file_assemble(Object(OCA\\\\Files_Trashbin\\\\Storage), 'files\\\/soft\\\/Prog...', '\\\/martinb\\\/files\\\/...')\\n#8 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/file.php(103): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->createFileChunked(Resource id #328)\\n#9 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/directory.php(134): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->put(Resource id #328)\\n#10 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(1036): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\Directory->createFile('Joomla_3.4.3-St...', Resource id #328)\\n#11 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/CorePlugin.php(525): Sabre\\\\DAV\\\\Server->createFile('soft\\\/Programas\\\/...', Resource id #328, NULL)\\n#12 [internal function]: Sabre\\\\DAV\\\\CorePlugin->httpPut(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#13 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/event\\\/lib\\\/EventEmitterTrait.php(105): call_user_func_array(Array, Array)\\n#14 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(459): Sabre\\\\Event\\\\EventEmitter->emit('method:PUT', Array)\\n#15 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(248): Sabre\\\\DAV\\\\Server->invokeMethod(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#16 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/appinfo\\\/v1\\\/webdav.php(55): Sabre\\\\DAV\\\\Server->exec()\\n#17 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/remote.php(138): require_once('\\\/var\\\/www\\\/client...')\\n#18 {main}\",\"File\":\"\\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/files\\\/view.php\",\"Line\":1583}","level":3,"time":"2016-03-24T19:21:01+00:00"}
{"reqId":"b5tL16ANZWItah\/uW6rM","remoteAddr":"192.168.1.2","app":"no app in context","message":"Exception: {\"Exception\":\"OCP\\\\Files\\\\NotFoundException\",\"Message\":\"\\\/soft\\\/Programas\\\/joomla\\\/core\\\/3.4\\\/old\\\/3.3.6\\\/Joomla_3.3.6-Stable-Full_Package.zip not found while trying to get owner\",\"Code\":0,\"Trace\":\"#0 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/files\\\/filesystem.php(913): OC\\\\Files\\\\View->getOwner('\\\/soft\\\/Programas...')\\n#1 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(191): OC\\\\Files\\\\Filesystem::getOwner('\\\/soft\\\/Programas...')\\n#2 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(145): OCA\\\\Activity\\\\FilesHooks->getSourcePathAndOwner('\\\/soft\\\/Programas...')\\n#3 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(101): OCA\\\\Activity\\\\FilesHooks->addNotificationsForFileAction('\\\/soft\\\/Programas...', 'file_created', 'created_self', 'created_by')\\n#4 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooksstatic.php(60): OCA\\\\Activity\\\\FilesHooks->fileCreate('\\\/soft\\\/Programas...')\\n#5 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/hook.php(105): OCA\\\\Activity\\\\FilesHooksStatic::fileCreate(Array)\\n#6 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/filechunking.php(223): OC_Hook::emit('OC_Filesystem', 'post_create', Array)\\n#7 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/file.php(436): OC_FileChunking->file_assemble(Object(OCA\\\\Files_Trashbin\\\\Storage), 'files\\\/soft\\\/Prog...', '\\\/martinb\\\/files\\\/...')\\n#8 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/file.php(103): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->createFileChunked(Resource id #328)\\n#9 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/directory.php(134): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->put(Resource id #328)\\n#10 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(1036): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\Directory->createFile('Joomla_3.3.6-St...', Resource id #328)\\n#11 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/CorePlugin.php(525): Sabre\\\\DAV\\\\Server->createFile('soft\\\/Programas\\\/...', Resource id #328, NULL)\\n#12 [internal function]: Sabre\\\\DAV\\\\CorePlugin->httpPut(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#13 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/event\\\/lib\\\/EventEmitterTrait.php(105): call_user_func_array(Array, Array)\\n#14 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(459): Sabre\\\\Event\\\\EventEmitter->emit('method:PUT', Array)\\n#15 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(248): Sabre\\\\DAV\\\\Server->invokeMethod(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#16 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/appinfo\\\/v1\\\/webdav.php(55): Sabre\\\\DAV\\\\Server->exec()\\n#17 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/remote.php(138): require_once('\\\/var\\\/www\\\/client...')\\n#18 {main}\",\"File\":\"\\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/files\\\/view.php\",\"Line\":1583}","level":3,"time":"2016-03-24T19:21:12+00:00"}
{"reqId":"BpgfGBqn0xrqvtVmjyp7","remoteAddr":"192.168.1.2","app":"no app in context","message":"Exception: {\"Exception\":\"OCP\\\\Files\\\\NotFoundException\",\"Message\":\"\\\/soft\\\/Programas\\\/joomla\\\/core\\\/3.5\\\/3.5.0\\\/Joomla_3.5.0-Stable-Full_Package.zip not found while trying to get owner\",\"Code\":0,\"Trace\":\"#0 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/files\\\/filesystem.php(913): OC\\\\Files\\\\View->getOwner('\\\/soft\\\/Programas...')\\n#1 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(191): OC\\\\Files\\\\Filesystem::getOwner('\\\/soft\\\/Programas...')\\n#2 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(145): OCA\\\\Activity\\\\FilesHooks->getSourcePathAndOwner('\\\/soft\\\/Programas...')\\n#3 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(101): OCA\\\\Activity\\\\FilesHooks->addNotificationsForFileAction('\\\/soft\\\/Programas...', 'file_created', 'created_self', 'created_by')\\n#4 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooksstatic.php(60): OCA\\\\Activity\\\\FilesHooks->fileCreate('\\\/soft\\\/Programas...')\\n#5 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/hook.php(105): OCA\\\\Activity\\\\FilesHooksStatic::fileCreate(Array)\\n#6 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/filechunking.php(223): OC_Hook::emit('OC_Filesystem', 'post_create', Array)\\n#7 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/file.php(436): OC_FileChunking->file_assemble(Object(OCA\\\\Files_Trashbin\\\\Storage), 'files\\\/soft\\\/Prog...', '\\\/martinb\\\/files\\\/...')\\n#8 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/file.php(103): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->createFileChunked(Resource id #328)\\n#9 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/directory.php(134): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->put(Resource id #328)\\n#10 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(1036): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\Directory->createFile('Joomla_3.5.0-St...', Resource id #328)\\n#11 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/CorePlugin.php(525): Sabre\\\\DAV\\\\Server->createFile('soft\\\/Programas\\\/...', Resource id #328, NULL)\\n#12 [internal function]: Sabre\\\\DAV\\\\CorePlugin->httpPut(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#13 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/event\\\/lib\\\/EventEmitterTrait.php(105): call_user_func_array(Array, Array)\\n#14 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(459): Sabre\\\\Event\\\\EventEmitter->emit('method:PUT', Array)\\n#15 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(248): Sabre\\\\DAV\\\\Server->invokeMethod(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#16 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/appinfo\\\/v1\\\/webdav.php(55): Sabre\\\\DAV\\\\Server->exec()\\n#17 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/remote.php(138): require_once('\\\/var\\\/www\\\/client...')\\n#18 {main}\",\"File\":\"\\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/files\\\/view.php\",\"Line\":1583}","level":3,"time":"2016-03-24T19:21:25+00:00"}
{"reqId":"QPxQx5jaQ0\/If3sn+CiI","remoteAddr":"192.168.1.2","app":"core","message":"Login failed: 'apc' (Remote IP: '192.168.1.2')","level":2,"time":"2016-03-24T19:30:40+00:00"}
{"reqId":"6ZuftMwfs73rfrom29OC","remoteAddr":"192.168.1.2","app":"no app in context","message":"Exception: {\"Exception\":\"OCP\\\\Files\\\\NotFoundException\",\"Message\":\"\\\/soft\\\/Programas\\\/joomla\\\/extensiones\\\/Componentes\\\/chat\\\/jbolo 2.7\\\/jbolo_2.7.zip not found while trying to get owner\",\"Code\":0,\"Trace\":\"#0 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/files\\\/filesystem.php(913): OC\\\\Files\\\\View->getOwner('\\\/soft\\\/Programas...')\\n#1 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(191): OC\\\\Files\\\\Filesystem::getOwner('\\\/soft\\\/Programas...')\\n#2 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(145): OCA\\\\Activity\\\\FilesHooks->getSourcePathAndOwner('\\\/soft\\\/Programas...')\\n#3 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(101): OCA\\\\Activity\\\\FilesHooks->addNotificationsForFileAction('\\\/soft\\\/Programas...', 'file_created', 'created_self', 'created_by')\\n#4 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooksstatic.php(60): OCA\\\\Activity\\\\FilesHooks->fileCreate('\\\/soft\\\/Programas...')\\n#5 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/hook.php(105): OCA\\\\Activity\\\\FilesHooksStatic::fileCreate(Array)\\n#6 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/filechunking.php(223): OC_Hook::emit('OC_Filesystem', 'post_create', Array)\\n#7 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/file.php(436): OC_FileChunking->file_assemble(Object(OCA\\\\Files_Trashbin\\\\Storage), 'files\\\/soft\\\/Prog...', '\\\/martinb\\\/files\\\/...')\\n#8 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/file.php(103): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->createFileChunked(Resource id #328)\\n#9 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/directory.php(134): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->put(Resource id #328)\\n#10 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(1036): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\Directory->createFile('jbolo_2.7.zip-c...', Resource id #328)\\n#11 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/CorePlugin.php(525): Sabre\\\\DAV\\\\Server->createFile('soft\\\/Programas\\\/...', Resource id #328, NULL)\\n#12 [internal function]: Sabre\\\\DAV\\\\CorePlugin->httpPut(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#13 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/event\\\/lib\\\/EventEmitterTrait.php(105): call_user_func_array(Array, Array)\\n#14 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(459): Sabre\\\\Event\\\\EventEmitter->emit('method:PUT', Array)\\n#15 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(248): Sabre\\\\DAV\\\\Server->invokeMethod(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#16 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/appinfo\\\/v1\\\/webdav.php(55): Sabre\\\\DAV\\\\Server->exec()\\n#17 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/remote.php(138): require_once('\\\/var\\\/www\\\/client...')\\n#18 {main}\",\"File\":\"\\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/files\\\/view.php\",\"Line\":1583}","level":3,"time":"2016-03-24T19:34:13+00:00"}
{"reqId":"5zsHMJBXqiGdGUZqXCkC","remoteAddr":"192.168.1.2","app":"no app in context","message":"Exception: {\"Exception\":\"OCP\\\\Files\\\\NotFoundException\",\"Message\":\"\\\/soft\\\/Programas\\\/joomla\\\/extensiones\\\/Componentes\\\/clasificados\\\/joomlistings\\\/jl217.zip not found while trying to get owner\",\"Code\":0,\"Trace\":\"#0 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/files\\\/filesystem.php(913): OC\\\\Files\\\\View->getOwner('\\\/soft\\\/Programas...')\\n#1 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(191): OC\\\\Files\\\\Filesystem::getOwner('\\\/soft\\\/Programas...')\\n#2 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(145): OCA\\\\Activity\\\\FilesHooks->getSourcePathAndOwner('\\\/soft\\\/Programas...')\\n#3 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(101): OCA\\\\Activity\\\\FilesHooks->addNotificationsForFileAction('\\\/soft\\\/Programas...', 'file_created', 'created_self', 'created_by')\\n#4 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooksstatic.php(60): OCA\\\\Activity\\\\FilesHooks->fileCreate('\\\/soft\\\/Programas...')\\n#5 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/hook.php(105): OCA\\\\Activity\\\\FilesHooksStatic::fileCreate(Array)\\n#6 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/filechunking.php(223): OC_Hook::emit('OC_Filesystem', 'post_create', Array)\\n#7 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/file.php(436): OC_FileChunking->file_assemble(Object(OCA\\\\Files_Trashbin\\\\Storage), 'files\\\/soft\\\/Prog...', '\\\/martinb\\\/files\\\/...')\\n#8 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/file.php(103): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->createFileChunked(Resource id #328)\\n#9 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/directory.php(134): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->put(Resource id #328)\\n#10 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(1036): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\Directory->createFile('jl217.zip-chunk...', Resource id #328)\\n#11 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/CorePlugin.php(525): Sabre\\\\DAV\\\\Server->createFile('soft\\\/Programas\\\/...', Resource id #328, NULL)\\n#12 [internal function]: Sabre\\\\DAV\\\\CorePlugin->httpPut(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#13 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/event\\\/lib\\\/EventEmitterTrait.php(105): call_user_func_array(Array, Array)\\n#14 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(459): Sabre\\\\Event\\\\EventEmitter->emit('method:PUT', Array)\\n#15 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(248): Sabre\\\\DAV\\\\Server->invokeMethod(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#16 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/appinfo\\\/v1\\\/webdav.php(55): Sabre\\\\DAV\\\\Server->exec()\\n#17 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/remote.php(138): require_once('\\\/var\\\/www\\\/client...')\\n#18 {main}\",\"File\":\"\\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/files\\\/view.php\",\"Line\":1583}","level":3,"time":"2016-03-24T19:39:44+00:00"}
{"reqId":"t3nRvb3sClxUaoyHYadL","remoteAddr":"192.168.1.2","app":"core","message":"Login failed: 'apc' (Remote IP: '192.168.1.2')","level":2,"time":"2016-03-24T19:42:40+00:00"}
{"reqId":"hf5t3CPzKWZhtambZVx2","remoteAddr":"192.168.1.2","app":"core","message":"Login failed: 'apc' (Remote IP: '192.168.1.2')","level":2,"time":"2016-03-24T19:46:39+00:00"}
{"reqId":"a9wc0cf2zFscw+3fkZ\/6","remoteAddr":"192.168.1.2","app":"core","message":"Login failed: 'apc' (Remote IP: '192.168.1.2')","level":2,"time":"2016-03-24T19:46:40+00:00"}
{"reqId":"jgyAzSCjjaQPFDMXqKn1","remoteAddr":"192.168.1.2","app":"core","message":"Login failed: 'apc' (Remote IP: '192.168.1.2')","level":2,"time":"2016-03-24T19:46:40+00:00"}
{"reqId":"7NBJLMA7BClg73yp6sJs","remoteAddr":"192.168.1.2","app":"core","message":"Login failed: 'apc' (Remote IP: '192.168.1.2')","level":2,"time":"2016-03-24T19:46:46+00:00"}

Hi! I have installed php 7.0.4 on my home server because all the praises about being fast. I installed it on my Ubuntu Server 14.04.4 LTS with ispConfig. The installation went just fine, and I also managed to enable PHP-FPM 7.0.4 on an apache virtual host subfolder only (yes, I have php 5.5.9 on virtualhost and in /cloud subfolder PHP 7.0.4 FPM) . Despite of this, my OC 2.1.1 sync client tells me that the sync of the stress test files will take above 3 hours!

Copying the stress test files through CIFS to my server takes about 3 to 5 minutes, maybe less.

This is not the first time I try to tackle this issue so I have prepared a very detailed bug report for @enoch85, @ApolloLV, @gluap, @PVince81 and @guruz so they can take a look at it. For you guys, basically I was able to setup PHP 7.0.4 with PHP-FPM on apache 2.4 virtualhost subfolder and seems to be woking right, I was also able to setup APCu 5.1.3 and seems to be caching ok (see details of apcu stats). Maybe you can take a look at my PHP-FPM pool config to optimize it a bit.

I have to mention that my sync client seems to sync 3 files then do a little sleep and then another 3 files, and so on...¿¿??

That being said, lets start to report this bug (or enhancement, as you like)...

Steps to reproduce

  1. On Ubuntu Server 14.04 Install PHP 7.0.4 following this guide https://www.howtoforge.com/tutorial/how-to-install-php-7-on-debian/#comments
  2. Enable PHP-FPM through ispConfig CP to enable it on web server
  3. Install APCu 5.1.3 with this command /opt/php-7.0.4/bin./pecl install channel://pecl.php.net/apcu-5.1.3
  4. Enable memcache in OwnCloud server config file
  5. Enable APCu extension=apcu.so in main php.ini file /opt/php-7.0.4/lib/php.ini
  6. Follow apache optimization guide here https://doc.owncloud.org/server/9.0/admin_manual/configuration_server/performance_tuning/webserver_tips.html#apache-tuning
  7. On the client side install latest OwnCloud Client (2.1.1)
  8. Put to sync the uncompressed stress test package

Expected behaviour

I expected that the sync will last less time!

Actual behaviour

The sync process is very slow!

Server configuration

Operating system: Ubuntu Server 14.04.4 LTS (Linux lucas 3.13.0-83-generic #127-Ubuntu SMP Fri Mar 11 00:25:37 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux)

Web server: Server version: Apache/2.4.7 (Ubuntu) - Server built: Jan 14 2016 17:45:23

Database: MySQL 5.5.47-0ubuntu0.14.04.1

PHP version: 7.0.4 (Server API: FPM/FastCGI)

ownCloud version: 9.0

Updated from an older ownCloud or fresh install: Updated from an older ownCloud

Where did you install ownCloud from: Manual Install

Apache virtual host PHP-FPM config:

#PHP-FPM
<IfModule mod_fastcgi.c>
    KeepAlive On
    KeepAliveTimeout 100
    MaxKeepAliveRequests 200

    <IfModule mod_headers.c>
      Header always set Strict-Transport-Security "max-age=15768000; includeSubDomains; preload"
    </IfModule>

    <Directory /var/www/it.mga.com/web/cloud>
        HostnameLookups Off   
        <FilesMatch "\.php[345]?$">
            SetHandler php7-fcgi
        </FilesMatch>
    </Directory>

    <Directory /var/XXX/clients/XXX/XXX/web/cloud/>
        HostnameLookups Off   
        <FilesMatch "\.php[345]?$">
            SetHandler php7-fcgi
        </FilesMatch>
    </Directory>

    <LocationMatch "/cloud/(fpm-ping|fpm-status)">
        HostnameLookups Off    
        SetHandler php7-fcgi-virt
        Action php7-fcgi-virt /php7-fcgi virtual
    </LocationMatch>

    Action php7-fcgi /php7-fcgi
    Alias /php7-fcgi /var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com
    FastCgiExternalServer /var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com -idle-timeout 300 -socket /var/lib/php5-fpm/XXX-cloud.sock -pass-header Authorization
</IfModule>

<IfModule mod_proxy_fcgi.c>
    ProxyPassMatch ^/(.*\.php[345]?(/.*)?)$ fcgi://127.0.0.1:9011/var/XXX/clients/XXX/XXX/web/cloud/$1
</IfModule>

PHP-FPM pool config:

[XXX-cloud]

listen = /var/lib/php5-fpm/XXX-cloud.sock
listen.allowed_clients = 127.0.0.1
listen.owner = XXX
listen.group = XXX
listen.mode = 0660
listen.backlog = 4096

user = XXX
group = XXX

;request_slowlog_timeout = 5s
;slowlog = '/var/XXX/clients/XXX/XXX/tmp/phplogs/php_cloud_fpm_slow.log'

request_terminate_timeout = 120s
rlimit_files = 131072
rlimit_core = unlimited
catch_workers_output = yes

pm = dynamic
pm.max_children = 10
pm.start_servers = 3
pm.min_spare_servers = 2
pm.max_spare_servers = 4
pm.max_requests = 400
pm.status_path = /cloud/fpm-status
ping.path = /cloud/fpm-ping
ping.response = 'Pong: *** XXX-cloud ***'

;chroot = '/var/XXX/clients/XXX/XXX/web/cloud/'
;chdir = /

; PHP Environment Variables Overrides
env[TMP] = '/var/XXX/clients/XXX/XXX/tmp'
env[TMPDIR] = '/var/XXX/clients/XXX/XXX/tmp'
env[TEMP] = '/var/XXX/clients/XXX/XXX/tmp'
env[PHP_DOCUMENT_ROOT] = '/var/XXX/clients/XXX/XXX/web/cloud'

; php.ini Overrides
php_admin_value[sendmail_path] = '/usr/sbin/sendmail -t -i -fwebmaster@it.mga.com'
php_admin_value[open_basedir] = '/var/XXX/clients/XXX/XXX/web/cloud:/var/XXX/clients/XXX/XXX/private:/var/XXX/clients/XXX/XXX/tmp:/var/www/it.mga.com/web/cloud:/srv/www/it.mga.com/web/cloud:/usr/share/php5:/usr/share/php:/tmp:/usr/share/phpmyadmin:/etc/phpmyadmin:/var/lib/phpmyadmin:/dev/urandom'
php_admin_value[session.save_path] = '/var/XXX/clients/XXX/XXX/tmp'
php_admin_value[upload_tmp_dir] = '/var/XXX/clients/XXX/XXX/tmp'
php_admin_value[disable_functions] = 'XXX,XXX,XXX'
php_admin_value[upload_max_filesize] = 1024M
php_admin_value[post_max_size] = 1024M
php_admin_value[memory_limit] = 1024M
php_admin_flag[mbstring.func_overload] = Off
php_admin_value[default_charset] = 'UTF-8'
php_admin_flag[output_buffering] = Off
php_admin_value[max_execution_time] = 6000
php_admin_flag[short_open_tag] = Off
php_admin_value[date.timezone] = 'America/XXX/XXX'
php_admin_flag[display_errors] = Off
php_admin_flag[html_errors] = Off
php_admin_value[error_reporting] = E_ALL
php_admin_flag[log_errors] = On
php_admin_value[error_log] = '/var/XXX/clients/XXX/XXX/tmp/phplogs/php_cloud.log'
php_admin_flag[expose_php] = Off

APCu 5.1.3 stats:

General Cache Information
APCu Version    5.1.3
PHP Version 7.0.4
APCu Host   it.mga.com (lucas) (192.168.1.77)
Server Software Apache/2.4.7 (Ubuntu)
Shared Memory   1 Segment(s) with 32.0 MBytes (mmap memory)
Start Time  2016/03/24 17:05:51
Uptime  1 hour and 13 minutes

Cache Information
Cached Variables    372 (250.0 KBytes)
Hits    1033293
Misses  17093
Request Rate (hits, misses) 239.54 cache requests/second
Hit Rate    235.64 cache requests/second
Miss Rate   3.90 cache requests/second
Insert Rate 3.90 cache requests/second
Cache full count    0

Runtime Settings
apc.coredump_unmap  0
apc.enable_cli  
apc.enabled 1
apc.entries_hint    4096
apc.gc_ttl  3600
apc.mmap_file_mask  
apc.preload_path    
apc.serializer  php
apc.shm_segments    1
apc.shm_size    32M
apc.slam_defense    1
apc.smart   0
apc.ttl 0
apc.use_request_time    1
apc.writable    /tmp

Server hardware

CPU: Intel(R) Core(TM) i7 860 @ 2.80GHz

Motherboard: Gigabyte P55M-UD2

RAM: 12GB 1333 MHz

Server System HDDs: SSD Samsung 840 120Gb

Server Storage HDDs: 2x WD Green WD20EARX 2TB (software RAID1 with mdadm)

Network: (LAN) 1000 Mbit/s down / 1000 Mbit/s up

Stress Test Info

Stress Test Files: https://www.en0ch.se/stress-test/

Client: 2.1.1

Top:

top - 17:25:49 up  3:26,  2 users,  load average: 2,68, 2,47, 2,36
Tareas: 225 total,   3 ejecutar,  222 hibernar,    0 detener,    0 zombie
%Cpu(s):  5,8 usuario,  3,3 sist,  0,0 adecuado, 80,6 inact,  9,9 en espera,  0,
KiB Mem:  12296816 total, 12149720 used,   147096 free,   193332 buffers
KiB Swap:        0 total,        0 used,        0 free. 10387584 cached Mem

  PID USUARIO   PR  NI    VIRT    RES    SHR S  %CPU %MEM     HORA+ ORDEN       
13827 web2      20   0  197296  21948   5596 S  17,9  0,2   0:59.61 php-fpm     
13739 web2      20   0  197292  21908   5556 R  11,6  0,2   1:03.46 php-fpm     
13857 web2      20   0  274888  25812   7424 S  10,6  0,2   0:35.13 php-fpm     
13826 web2      20   0  197296  21908   5556 S  10,0  0,2   0:49.06 php-fpm     
13740 web2      20   0  197292  21936   5636 S   9,3  0,2   1:12.93 php-fpm 

Signing status (ownCloud 9.0 and above):

No errors have been found.

List of activated apps:

Enabled:
  - activity: 2.2.1
  - comments: 0.2
  - dav: 0.1.5
  - federatedfilesharing: 0.1.0
  - federation: 0.0.4
  - files: 1.4.4
  - files_pdfviewer: 0.8
  - files_sharing: 0.9.1
  - files_texteditor: 2.1
  - files_trashbin: 0.8.0
  - files_versions: 1.2.0
  - files_videoplayer: 0.9.8
  - firstrunwizard: 1.1
  - gallery: 14.5.0
  - notifications: 0.2.3
  - provisioning_api: 0.4.1
  - systemtags: 0.2
  - templateeditor: 0.1
  - updatenotification: 0.1.0
Disabled:
  - encryption
  - external
  - files_external
  - user_external
  - user_ldap

The content of config/config.php:

list system
{
    "system": {
        "instanceid": "ocl00gp133cg",
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": [
            "it.mga.com"
        ],
        "datadirectory": "\/var\/XXX\/clients\/XXX\/XXX\/web\/cloud\/data",
        "overwrite.cli.url": "https:\/\/it.mga.com\/cloud",
        "dbtype": "mysql",
        "version": "9.0.0.19",
        "dbname": "c1_cloud",
        "dbhost": "127.0.0.1",
        "dbtableprefix": "oc_",
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "logtimezone": "America\/Argentina\/Buenos_Aires",
        "installed": true,
        "forcessl": true,
        "theme": "",
        "maintenance": false,
        "mail_from_address": "martinb",
        "mail_smtpmode": "php",
        "mail_domain": "mga.com",
        "memcache.local": "\\OC\\Memcache\\APCu",
        "loglevel": 1,
        "trashbin_retention_obligation": "auto"
    }
}

Are you using external storage, if yes which one: Nope

Are you using encryption: no

Are you using an external user-backend, if yes which one: Nope

Client configuration

Browser: Firefox 45.0

Operating system: Ubuntu 16.10

Logs

Web server error log

[Thu Mar 24 16:05:11.397590 2016] [:error] [pid 8713] [client 192.168.1.2:39136] FastCGI: server "/var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com" stderr: Primary script unknown
[Thu Mar 24 16:05:13.857488 2016] [:error] [pid 8713] [client 192.168.1.2:39136] FastCGI: server "/var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com" stderr: Primary script unknown
[Thu Mar 24 16:05:13.897382 2016] [:error] [pid 8713] [client 192.168.1.2:39136] FastCGI: server "/var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com" stderr: Primary script unknown
[Thu Mar 24 16:05:23.729197 2016] [:error] [pid 8713] [client 192.168.1.2:39136] FastCGI: server "/var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com" stderr: Primary script unknown
[Thu Mar 24 16:05:28.773171 2016] [:error] [pid 8713] [client 192.168.1.2:39136] FastCGI: server "/var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com" stderr: Primary script unknown
[Thu Mar 24 16:05:33.817182 2016] [:error] [pid 8713] [client 192.168.1.2:39136] FastCGI: server "/var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com" stderr: Primary script unknown
[Thu Mar 24 16:05:33.838210 2016] [:error] [pid 8598] [client 192.168.1.2:39140] FastCGI: server "/var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com" stderr: Primary script unknown
[Thu Mar 24 16:05:38.861196 2016] [:error] [pid 8713] [client 192.168.1.2:39136] FastCGI: server "/var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com" stderr: Primary script unknown
[Thu Mar 24 16:05:40.817157 2016] [:error] [pid 8713] [client 192.168.1.2:39136] FastCGI: server "/var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com" stderr: Primary script unknown
[Thu Mar 24 16:06:12.785681 2016] [:error] [pid 8713] [client 192.168.1.2:39136] FastCGI: server "/var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com" stderr: Primary script unknown
[Thu Mar 24 16:06:12.789222 2016] [:error] [pid 8713] [client 192.168.1.2:39136] FastCGI: server "/var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com" stderr: Primary script unknown
[Thu Mar 24 16:31:08.858862 2016] [fastcgi:error] [pid 10480] (104)Connection reset by peer: [client 192.168.1.2:39306] FastCGI: comm with server "/var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com" aborted: read failed
[Thu Mar 24 16:31:08.858949 2016] [fastcgi:error] [pid 10480] [client 192.168.1.2:39306] FastCGI: incomplete headers (0 bytes) received from server "/var/XXX/clients/XXX/XXX/cgi-bin/php7-fcgi-*-443-it.mga.com"

ownCloud log (data/owncloud.log)

eqId":"yKsUAo6Olzfy0HP+dx3Z","remoteAddr":"192.168.1.2","app":"core","message":"Login failed: 'apc' (Remote IP: '192.168.1.2')","level":2,"time":"2016-03-24T19:18:41+00:00"}
{"reqId":"BFdB08p0dkI7GAQc2Z7Z","remoteAddr":"192.168.1.2","app":"no app in context","message":"Exception: {\"Exception\":\"OCP\\\\Files\\\\NotFoundException\",\"Message\":\"\\\/soft\\\/Programas\\\/iso2usb\\\/tuxboot-0.8.3.exe not found while trying to get owner\",\"Code\":0,\"Trace\":\"#0 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/files\\\/filesystem.php(913): OC\\\\Files\\\\View->getOwner('\\\/soft\\\/Programas...')\\n#1 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(191): OC\\\\Files\\\\Filesystem::getOwner('\\\/soft\\\/Programas...')\\n#2 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(145): OCA\\\\Activity\\\\FilesHooks->getSourcePathAndOwner('\\\/soft\\\/Programas...')\\n#3 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(101): OCA\\\\Activity\\\\FilesHooks->addNotificationsForFileAction('\\\/soft\\\/Programas...', 'file_created', 'created_self', 'created_by')\\n#4 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooksstatic.php(60): OCA\\\\Activity\\\\FilesHooks->fileCreate('\\\/soft\\\/Programas...')\\n#5 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/hook.php(105): OCA\\\\Activity\\\\FilesHooksStatic::fileCreate(Array)\\n#6 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/filechunking.php(223): OC_Hook::emit('OC_Filesystem', 'post_create', Array)\\n#7 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/file.php(436): OC_FileChunking->file_assemble(Object(OCA\\\\Files_Trashbin\\\\Storage), 'files\\\/soft\\\/Prog...', '\\\/martinb\\\/files\\\/...')\\n#8 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/file.php(103): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->createFileChunked(Resource id #328)\\n#9 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/directory.php(134): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->put(Resource id #328)\\n#10 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(1036): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\Directory->createFile('tuxboot-0.8.3.e...', Resource id #328)\\n#11 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/CorePlugin.php(525): Sabre\\\\DAV\\\\Server->createFile('soft\\\/Programas\\\/...', Resource id #328, NULL)\\n#12 [internal function]: Sabre\\\\DAV\\\\CorePlugin->httpPut(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#13 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/event\\\/lib\\\/EventEmitterTrait.php(105): call_user_func_array(Array, Array)\\n#14 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(459): Sabre\\\\Event\\\\EventEmitter->emit('method:PUT', Array)\\n#15 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(248): Sabre\\\\DAV\\\\Server->invokeMethod(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#16 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/appinfo\\\/v1\\\/webdav.php(55): Sabre\\\\DAV\\\\Server->exec()\\n#17 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/remote.php(138): require_once('\\\/var\\\/www\\\/client...')\\n#18 {main}\",\"File\":\"\\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/files\\\/view.php\",\"Line\":1583}","level":3,"time":"2016-03-24T19:19:27+00:00"}
{"reqId":"IHfPmO1eM6+12tCntmmF","remoteAddr":"192.168.1.2","app":"no app in context","message":"Exception: {\"Exception\":\"OCP\\\\Files\\\\NotFoundException\",\"Message\":\"\\\/soft\\\/Programas\\\/joomla\\\/core\\\/3.4\\\/3.4.3\\\/Joomla_3.4.3-Stable-Full_Package.zip not found while trying to get owner\",\"Code\":0,\"Trace\":\"#0 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/files\\\/filesystem.php(913): OC\\\\Files\\\\View->getOwner('\\\/soft\\\/Programas...')\\n#1 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(191): OC\\\\Files\\\\Filesystem::getOwner('\\\/soft\\\/Programas...')\\n#2 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(145): OCA\\\\Activity\\\\FilesHooks->getSourcePathAndOwner('\\\/soft\\\/Programas...')\\n#3 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(101): OCA\\\\Activity\\\\FilesHooks->addNotificationsForFileAction('\\\/soft\\\/Programas...', 'file_created', 'created_self', 'created_by')\\n#4 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooksstatic.php(60): OCA\\\\Activity\\\\FilesHooks->fileCreate('\\\/soft\\\/Programas...')\\n#5 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/hook.php(105): OCA\\\\Activity\\\\FilesHooksStatic::fileCreate(Array)\\n#6 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/filechunking.php(223): OC_Hook::emit('OC_Filesystem', 'post_create', Array)\\n#7 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/file.php(436): OC_FileChunking->file_assemble(Object(OCA\\\\Files_Trashbin\\\\Storage), 'files\\\/soft\\\/Prog...', '\\\/martinb\\\/files\\\/...')\\n#8 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/file.php(103): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->createFileChunked(Resource id #328)\\n#9 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/directory.php(134): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->put(Resource id #328)\\n#10 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(1036): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\Directory->createFile('Joomla_3.4.3-St...', Resource id #328)\\n#11 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/CorePlugin.php(525): Sabre\\\\DAV\\\\Server->createFile('soft\\\/Programas\\\/...', Resource id #328, NULL)\\n#12 [internal function]: Sabre\\\\DAV\\\\CorePlugin->httpPut(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#13 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/event\\\/lib\\\/EventEmitterTrait.php(105): call_user_func_array(Array, Array)\\n#14 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(459): Sabre\\\\Event\\\\EventEmitter->emit('method:PUT', Array)\\n#15 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(248): Sabre\\\\DAV\\\\Server->invokeMethod(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#16 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/appinfo\\\/v1\\\/webdav.php(55): Sabre\\\\DAV\\\\Server->exec()\\n#17 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/remote.php(138): require_once('\\\/var\\\/www\\\/client...')\\n#18 {main}\",\"File\":\"\\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/files\\\/view.php\",\"Line\":1583}","level":3,"time":"2016-03-24T19:21:01+00:00"}
{"reqId":"b5tL16ANZWItah\/uW6rM","remoteAddr":"192.168.1.2","app":"no app in context","message":"Exception: {\"Exception\":\"OCP\\\\Files\\\\NotFoundException\",\"Message\":\"\\\/soft\\\/Programas\\\/joomla\\\/core\\\/3.4\\\/old\\\/3.3.6\\\/Joomla_3.3.6-Stable-Full_Package.zip not found while trying to get owner\",\"Code\":0,\"Trace\":\"#0 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/files\\\/filesystem.php(913): OC\\\\Files\\\\View->getOwner('\\\/soft\\\/Programas...')\\n#1 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(191): OC\\\\Files\\\\Filesystem::getOwner('\\\/soft\\\/Programas...')\\n#2 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(145): OCA\\\\Activity\\\\FilesHooks->getSourcePathAndOwner('\\\/soft\\\/Programas...')\\n#3 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(101): OCA\\\\Activity\\\\FilesHooks->addNotificationsForFileAction('\\\/soft\\\/Programas...', 'file_created', 'created_self', 'created_by')\\n#4 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooksstatic.php(60): OCA\\\\Activity\\\\FilesHooks->fileCreate('\\\/soft\\\/Programas...')\\n#5 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/hook.php(105): OCA\\\\Activity\\\\FilesHooksStatic::fileCreate(Array)\\n#6 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/filechunking.php(223): OC_Hook::emit('OC_Filesystem', 'post_create', Array)\\n#7 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/file.php(436): OC_FileChunking->file_assemble(Object(OCA\\\\Files_Trashbin\\\\Storage), 'files\\\/soft\\\/Prog...', '\\\/martinb\\\/files\\\/...')\\n#8 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/file.php(103): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->createFileChunked(Resource id #328)\\n#9 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/directory.php(134): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->put(Resource id #328)\\n#10 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(1036): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\Directory->createFile('Joomla_3.3.6-St...', Resource id #328)\\n#11 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/CorePlugin.php(525): Sabre\\\\DAV\\\\Server->createFile('soft\\\/Programas\\\/...', Resource id #328, NULL)\\n#12 [internal function]: Sabre\\\\DAV\\\\CorePlugin->httpPut(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#13 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/event\\\/lib\\\/EventEmitterTrait.php(105): call_user_func_array(Array, Array)\\n#14 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(459): Sabre\\\\Event\\\\EventEmitter->emit('method:PUT', Array)\\n#15 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(248): Sabre\\\\DAV\\\\Server->invokeMethod(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#16 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/appinfo\\\/v1\\\/webdav.php(55): Sabre\\\\DAV\\\\Server->exec()\\n#17 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/remote.php(138): require_once('\\\/var\\\/www\\\/client...')\\n#18 {main}\",\"File\":\"\\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/files\\\/view.php\",\"Line\":1583}","level":3,"time":"2016-03-24T19:21:12+00:00"}
{"reqId":"BpgfGBqn0xrqvtVmjyp7","remoteAddr":"192.168.1.2","app":"no app in context","message":"Exception: {\"Exception\":\"OCP\\\\Files\\\\NotFoundException\",\"Message\":\"\\\/soft\\\/Programas\\\/joomla\\\/core\\\/3.5\\\/3.5.0\\\/Joomla_3.5.0-Stable-Full_Package.zip not found while trying to get owner\",\"Code\":0,\"Trace\":\"#0 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/files\\\/filesystem.php(913): OC\\\\Files\\\\View->getOwner('\\\/soft\\\/Programas...')\\n#1 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(191): OC\\\\Files\\\\Filesystem::getOwner('\\\/soft\\\/Programas...')\\n#2 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(145): OCA\\\\Activity\\\\FilesHooks->getSourcePathAndOwner('\\\/soft\\\/Programas...')\\n#3 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(101): OCA\\\\Activity\\\\FilesHooks->addNotificationsForFileAction('\\\/soft\\\/Programas...', 'file_created', 'created_self', 'created_by')\\n#4 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooksstatic.php(60): OCA\\\\Activity\\\\FilesHooks->fileCreate('\\\/soft\\\/Programas...')\\n#5 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/hook.php(105): OCA\\\\Activity\\\\FilesHooksStatic::fileCreate(Array)\\n#6 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/filechunking.php(223): OC_Hook::emit('OC_Filesystem', 'post_create', Array)\\n#7 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/file.php(436): OC_FileChunking->file_assemble(Object(OCA\\\\Files_Trashbin\\\\Storage), 'files\\\/soft\\\/Prog...', '\\\/martinb\\\/files\\\/...')\\n#8 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/file.php(103): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->createFileChunked(Resource id #328)\\n#9 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/directory.php(134): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->put(Resource id #328)\\n#10 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(1036): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\Directory->createFile('Joomla_3.5.0-St...', Resource id #328)\\n#11 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/CorePlugin.php(525): Sabre\\\\DAV\\\\Server->createFile('soft\\\/Programas\\\/...', Resource id #328, NULL)\\n#12 [internal function]: Sabre\\\\DAV\\\\CorePlugin->httpPut(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#13 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/event\\\/lib\\\/EventEmitterTrait.php(105): call_user_func_array(Array, Array)\\n#14 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(459): Sabre\\\\Event\\\\EventEmitter->emit('method:PUT', Array)\\n#15 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(248): Sabre\\\\DAV\\\\Server->invokeMethod(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#16 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/appinfo\\\/v1\\\/webdav.php(55): Sabre\\\\DAV\\\\Server->exec()\\n#17 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/remote.php(138): require_once('\\\/var\\\/www\\\/client...')\\n#18 {main}\",\"File\":\"\\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/files\\\/view.php\",\"Line\":1583}","level":3,"time":"2016-03-24T19:21:25+00:00"}
{"reqId":"QPxQx5jaQ0\/If3sn+CiI","remoteAddr":"192.168.1.2","app":"core","message":"Login failed: 'apc' (Remote IP: '192.168.1.2')","level":2,"time":"2016-03-24T19:30:40+00:00"}
{"reqId":"6ZuftMwfs73rfrom29OC","remoteAddr":"192.168.1.2","app":"no app in context","message":"Exception: {\"Exception\":\"OCP\\\\Files\\\\NotFoundException\",\"Message\":\"\\\/soft\\\/Programas\\\/joomla\\\/extensiones\\\/Componentes\\\/chat\\\/jbolo 2.7\\\/jbolo_2.7.zip not found while trying to get owner\",\"Code\":0,\"Trace\":\"#0 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/files\\\/filesystem.php(913): OC\\\\Files\\\\View->getOwner('\\\/soft\\\/Programas...')\\n#1 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(191): OC\\\\Files\\\\Filesystem::getOwner('\\\/soft\\\/Programas...')\\n#2 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(145): OCA\\\\Activity\\\\FilesHooks->getSourcePathAndOwner('\\\/soft\\\/Programas...')\\n#3 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(101): OCA\\\\Activity\\\\FilesHooks->addNotificationsForFileAction('\\\/soft\\\/Programas...', 'file_created', 'created_self', 'created_by')\\n#4 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooksstatic.php(60): OCA\\\\Activity\\\\FilesHooks->fileCreate('\\\/soft\\\/Programas...')\\n#5 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/hook.php(105): OCA\\\\Activity\\\\FilesHooksStatic::fileCreate(Array)\\n#6 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/filechunking.php(223): OC_Hook::emit('OC_Filesystem', 'post_create', Array)\\n#7 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/file.php(436): OC_FileChunking->file_assemble(Object(OCA\\\\Files_Trashbin\\\\Storage), 'files\\\/soft\\\/Prog...', '\\\/martinb\\\/files\\\/...')\\n#8 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/file.php(103): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->createFileChunked(Resource id #328)\\n#9 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/directory.php(134): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->put(Resource id #328)\\n#10 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(1036): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\Directory->createFile('jbolo_2.7.zip-c...', Resource id #328)\\n#11 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/CorePlugin.php(525): Sabre\\\\DAV\\\\Server->createFile('soft\\\/Programas\\\/...', Resource id #328, NULL)\\n#12 [internal function]: Sabre\\\\DAV\\\\CorePlugin->httpPut(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#13 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/event\\\/lib\\\/EventEmitterTrait.php(105): call_user_func_array(Array, Array)\\n#14 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(459): Sabre\\\\Event\\\\EventEmitter->emit('method:PUT', Array)\\n#15 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(248): Sabre\\\\DAV\\\\Server->invokeMethod(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#16 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/appinfo\\\/v1\\\/webdav.php(55): Sabre\\\\DAV\\\\Server->exec()\\n#17 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/remote.php(138): require_once('\\\/var\\\/www\\\/client...')\\n#18 {main}\",\"File\":\"\\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/files\\\/view.php\",\"Line\":1583}","level":3,"time":"2016-03-24T19:34:13+00:00"}
{"reqId":"5zsHMJBXqiGdGUZqXCkC","remoteAddr":"192.168.1.2","app":"no app in context","message":"Exception: {\"Exception\":\"OCP\\\\Files\\\\NotFoundException\",\"Message\":\"\\\/soft\\\/Programas\\\/joomla\\\/extensiones\\\/Componentes\\\/clasificados\\\/joomlistings\\\/jl217.zip not found while trying to get owner\",\"Code\":0,\"Trace\":\"#0 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/files\\\/filesystem.php(913): OC\\\\Files\\\\View->getOwner('\\\/soft\\\/Programas...')\\n#1 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(191): OC\\\\Files\\\\Filesystem::getOwner('\\\/soft\\\/Programas...')\\n#2 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(145): OCA\\\\Activity\\\\FilesHooks->getSourcePathAndOwner('\\\/soft\\\/Programas...')\\n#3 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooks.php(101): OCA\\\\Activity\\\\FilesHooks->addNotificationsForFileAction('\\\/soft\\\/Programas...', 'file_created', 'created_self', 'created_by')\\n#4 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/activity\\\/lib\\\/fileshooksstatic.php(60): OCA\\\\Activity\\\\FilesHooks->fileCreate('\\\/soft\\\/Programas...')\\n#5 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/hook.php(105): OCA\\\\Activity\\\\FilesHooksStatic::fileCreate(Array)\\n#6 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/filechunking.php(223): OC_Hook::emit('OC_Filesystem', 'post_create', Array)\\n#7 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/file.php(436): OC_FileChunking->file_assemble(Object(OCA\\\\Files_Trashbin\\\\Storage), 'files\\\/soft\\\/Prog...', '\\\/martinb\\\/files\\\/...')\\n#8 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/file.php(103): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->createFileChunked(Resource id #328)\\n#9 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/lib\\\/connector\\\/sabre\\\/directory.php(134): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->put(Resource id #328)\\n#10 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(1036): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\Directory->createFile('jl217.zip-chunk...', Resource id #328)\\n#11 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/CorePlugin.php(525): Sabre\\\\DAV\\\\Server->createFile('soft\\\/Programas\\\/...', Resource id #328, NULL)\\n#12 [internal function]: Sabre\\\\DAV\\\\CorePlugin->httpPut(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#13 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/event\\\/lib\\\/EventEmitterTrait.php(105): call_user_func_array(Array, Array)\\n#14 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(459): Sabre\\\\Event\\\\EventEmitter->emit('method:PUT', Array)\\n#15 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(248): Sabre\\\\DAV\\\\Server->invokeMethod(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#16 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/apps\\\/dav\\\/appinfo\\\/v1\\\/webdav.php(55): Sabre\\\\DAV\\\\Server->exec()\\n#17 \\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/remote.php(138): require_once('\\\/var\\\/www\\\/client...')\\n#18 {main}\",\"File\":\"\\\/var\\\/www\\\/clients\\\/client1\\\/web2\\\/web\\\/cloud\\\/lib\\\/private\\\/files\\\/view.php\",\"Line\":1583}","level":3,"time":"2016-03-24T19:39:44+00:00"}
{"reqId":"t3nRvb3sClxUaoyHYadL","remoteAddr":"192.168.1.2","app":"core","message":"Login failed: 'apc' (Remote IP: '192.168.1.2')","level":2,"time":"2016-03-24T19:42:40+00:00"}
{"reqId":"hf5t3CPzKWZhtambZVx2","remoteAddr":"192.168.1.2","app":"core","message":"Login failed: 'apc' (Remote IP: '192.168.1.2')","level":2,"time":"2016-03-24T19:46:39+00:00"}
{"reqId":"a9wc0cf2zFscw+3fkZ\/6","remoteAddr":"192.168.1.2","app":"core","message":"Login failed: 'apc' (Remote IP: '192.168.1.2')","level":2,"time":"2016-03-24T19:46:40+00:00"}
{"reqId":"jgyAzSCjjaQPFDMXqKn1","remoteAddr":"192.168.1.2","app":"core","message":"Login failed: 'apc' (Remote IP: '192.168.1.2')","level":2,"time":"2016-03-24T19:46:40+00:00"}
{"reqId":"7NBJLMA7BClg73yp6sJs","remoteAddr":"192.168.1.2","app":"core","message":"Login failed: 'apc' (Remote IP: '192.168.1.2')","level":2,"time":"2016-03-24T19:46:46+00:00"}
@enoch85

This comment has been minimized.

Show comment
Hide comment
@enoch85

enoch85 Mar 25, 2016

Member

@ghiamar PHP-FPM is not as fast as CLI for some reason. For me with almost the same setup (CLI) it takes 4-5 minutes.

Member

enoch85 commented Mar 25, 2016

@ghiamar PHP-FPM is not as fast as CLI for some reason. For me with almost the same setup (CLI) it takes 4-5 minutes.

@mgscreativa

This comment has been minimized.

Show comment
Hide comment
@mgscreativa

mgscreativa Mar 25, 2016

Hi @enoch85! Would you please disclose your detailed apache/php/apcu config so I can try that?

Thanks!

Hi @enoch85! Would you please disclose your detailed apache/php/apcu config so I can try that?

Thanks!

@enoch85

This comment has been minimized.

Show comment
Hide comment
@enoch85

enoch85 Mar 25, 2016

Member

My setup involves a NGINX reverse proxy, Apache 2.4, MySQL 5.5, Redis cache, and a regular core i5 processor (3570K) clocked at 4.2 Ghz. My network is 100/100 Mb Swedish fiber and performs very good. #20963 (comment)

It would be eaiser for you of you want to test "my system" to download this VM: https://www.techandme.se/pre-configured-owncloud-installaton/

You could also connect to my demoserver: https://owncloudphp7.techandme.se
USER: testuser
PASS: testingphp7

Member

enoch85 commented Mar 25, 2016

My setup involves a NGINX reverse proxy, Apache 2.4, MySQL 5.5, Redis cache, and a regular core i5 processor (3570K) clocked at 4.2 Ghz. My network is 100/100 Mb Swedish fiber and performs very good. #20963 (comment)

It would be eaiser for you of you want to test "my system" to download this VM: https://www.techandme.se/pre-configured-owncloud-installaton/

You could also connect to my demoserver: https://owncloudphp7.techandme.se
USER: testuser
PASS: testingphp7

@mgscreativa

This comment has been minimized.

Show comment
Hide comment
@mgscreativa

mgscreativa Mar 25, 2016

Ok @enoch85, so if I got this right, I shoud try your vm and check the config there to try to figure it out best config for me, that's right?

Thanks!

Ok @enoch85, so if I got this right, I shoud try your vm and check the config there to try to figure it out best config for me, that's right?

Thanks!

@enoch85

This comment has been minimized.

Show comment
Hide comment
@enoch85

enoch85 Mar 25, 2016

Member

@ghiamar I would leave PHP-FPM if possible. There are no special config tweaks or so, just a basic install really, but with CLI and not FPM. Then it could be so many different factors to your slowness than just your conifg, network, server, and so on...

Here are the script(s) I use for installing: https://github.com/enoch85/ownCloud-VM/blob/master/production/owncloud_install_production.sh

Member

enoch85 commented Mar 25, 2016

@ghiamar I would leave PHP-FPM if possible. There are no special config tweaks or so, just a basic install really, but with CLI and not FPM. Then it could be so many different factors to your slowness than just your conifg, network, server, and so on...

Here are the script(s) I use for installing: https://github.com/enoch85/ownCloud-VM/blob/master/production/owncloud_install_production.sh

@mgscreativa

This comment has been minimized.

Show comment
Hide comment
@mgscreativa

mgscreativa Mar 25, 2016

Thanks @enoch85, will check that script and let you know

Thanks @enoch85, will check that script and let you know

@mgscreativa

This comment has been minimized.

Show comment
Hide comment
@mgscreativa

mgscreativa Mar 26, 2016

Hi @enoch85! I want to report that following your VM scripts installation I finally got the speed desired for the stress test (around 5 minutes).

I did clean install Ubuntu Server 14.04.4, and manually followed your scripts commands and got it just fine. Now I will try to replicate that on my production server to see if I can get that speed. Maybe the REDIS cache will do the trick, will check and let you know.

Hi @enoch85! I want to report that following your VM scripts installation I finally got the speed desired for the stress test (around 5 minutes).

I did clean install Ubuntu Server 14.04.4, and manually followed your scripts commands and got it just fine. Now I will try to replicate that on my production server to see if I can get that speed. Maybe the REDIS cache will do the trick, will check and let you know.

@mgscreativa

This comment has been minimized.

Show comment
Hide comment
@mgscreativa

mgscreativa Mar 27, 2016

Well, after the whole day testing, I may say that maybe is something wrong with my server config/setup, because trying the VM methox from here https://github.com/enoch85/ownCloud-VM/blob/master/production/owncloud_install_production.sh it works just fine and synces all small files in about 5 minutes and on my real server it takes about 1 hour!, at least I was able to reduce it from 3 hours!

Thanks a lot for all the support!

Well, after the whole day testing, I may say that maybe is something wrong with my server config/setup, because trying the VM methox from here https://github.com/enoch85/ownCloud-VM/blob/master/production/owncloud_install_production.sh it works just fine and synces all small files in about 5 minutes and on my real server it takes about 1 hour!, at least I was able to reduce it from 3 hours!

Thanks a lot for all the support!

@divinity76

This comment has been minimized.

Show comment
Hide comment
@divinity76

divinity76 Mar 30, 2016

the problem's still present.
it looks like a Nagle Algorithm problem, you'll have the same effect with SSH if you disable TCP_NODELAY in your ssh client (not all ssh clients support disabling it, but PuTTY does. all sane SSH clients enable it by default, though);
add TCP_NODELAY to the OwnCloud client socket, does that make small files faster?

the problem's still present.
it looks like a Nagle Algorithm problem, you'll have the same effect with SSH if you disable TCP_NODELAY in your ssh client (not all ssh clients support disabling it, but PuTTY does. all sane SSH clients enable it by default, though);
add TCP_NODELAY to the OwnCloud client socket, does that make small files faster?

@mgscreativa

This comment has been minimized.

Show comment
Hide comment
@mgscreativa

mgscreativa Mar 30, 2016

hi @divinity76!, Where should I add that exactly?

By the way, I have tested in three scenarios, one VM installed with https://github.com/enoch85/ownCloud-VM/blob/master/production/owncloud_install_production.sh, a second VM using a fresh Ubuntu Server 14.04.4 installing ISPConfig and a third scenario using a owncloud docker image, in all of them, the file syncing goes just fine, the only slow thing is my real LAN server.

I really don't know what can be causing the slowness, but I really don't care now, because I know that is my server, will waith till Ubuntu Server 16.04 releases so I can test in that new version...

hi @divinity76!, Where should I add that exactly?

By the way, I have tested in three scenarios, one VM installed with https://github.com/enoch85/ownCloud-VM/blob/master/production/owncloud_install_production.sh, a second VM using a fresh Ubuntu Server 14.04.4 installing ISPConfig and a third scenario using a owncloud docker image, in all of them, the file syncing goes just fine, the only slow thing is my real LAN server.

I really don't know what can be causing the slowness, but I really don't care now, because I know that is my server, will waith till Ubuntu Server 16.04 releases so I can test in that new version...

@divinity76

This comment has been minimized.

Show comment
Hide comment
@divinity76

divinity76 Mar 30, 2016

do i look like an ownCloud Client dev? :p or to say it another way, i don't know, but my best guess is
client/src/libsync/abstractnetworkjob.cpp in void AbstractNetworkJob::setupConnections

do i look like an ownCloud Client dev? :p or to say it another way, i don't know, but my best guess is
client/src/libsync/abstractnetworkjob.cpp in void AbstractNetworkJob::setupConnections

@guruz

This comment has been minimized.

Show comment
Hide comment
@guruz

guruz Mar 30, 2016

Contributor

If you don't have issues with server performance/load I suggest to try a nightly build of oC client 2.2.x
It automatically syncs more files at once if they are small files
http://download.owncloud.com/desktop/daily/
https://software.opensuse.org/download.html?project=isv%3AownCloud%3Acommunity%3Anightly&package=owncloud-client

Contributor

guruz commented Mar 30, 2016

If you don't have issues with server performance/load I suggest to try a nightly build of oC client 2.2.x
It automatically syncs more files at once if they are small files
http://download.owncloud.com/desktop/daily/
https://software.opensuse.org/download.html?project=isv%3AownCloud%3Acommunity%3Anightly&package=owncloud-client

@mgscreativa

This comment has been minimized.

Show comment
Hide comment
@mgscreativa

mgscreativa Mar 30, 2016

Nope...installed Revisión Git 173056 en Mar 30 2016 but the slowness persists. I really don't care now, because I was able to check that is an issue on my 2 years old server installation, maybe in that time, I setup something that causes the pauses for security. Anyway, will wait to Ubuntu Server 16.04 release an try again. Will let you know then.

Nope...installed Revisión Git 173056 en Mar 30 2016 but the slowness persists. I really don't care now, because I was able to check that is an issue on my 2 years old server installation, maybe in that time, I setup something that causes the pauses for security. Anyway, will wait to Ubuntu Server 16.04 release an try again. Will let you know then.

@divinity76

This comment has been minimized.

Show comment
Hide comment
@divinity76

divinity76 Mar 31, 2016

@ghiama why do you think this is an OS issue?

@ghiama why do you think this is an OS issue?

@mgscreativa

This comment has been minimized.

Show comment
Hide comment
@mgscreativa

mgscreativa Mar 31, 2016

Hi @divinity76.

I think of it because the test I've made, in three different VM scenarios, using my Laptop connected to my WiFi LAN the stress test files sync is really quick, but testing to my real LAN server, the stress test files sync take a very long time to sync compared to the other scenarios.

As you can see on my previous posts here, you can check my server specs and realize that is solid rock, but still OC is slow, so, in my opinion, maybe there's something I installed on my server on this two years run that maybe, got this slowness with OC, maybe it's a security measure, because the files sync very fast, but by batches of three.

Thanks in you interest.

Hi @divinity76.

I think of it because the test I've made, in three different VM scenarios, using my Laptop connected to my WiFi LAN the stress test files sync is really quick, but testing to my real LAN server, the stress test files sync take a very long time to sync compared to the other scenarios.

As you can see on my previous posts here, you can check my server specs and realize that is solid rock, but still OC is slow, so, in my opinion, maybe there's something I installed on my server on this two years run that maybe, got this slowness with OC, maybe it's a security measure, because the files sync very fast, but by batches of three.

Thanks in you interest.

@adrianvg

This comment has been minimized.

Show comment
Hide comment
@adrianvg

adrianvg Apr 7, 2016

@guruz;
Are there any nightly builds for CentOS 7 available as well?
I took the (maybe premature) step to move my local homefolder to Owncloud to get a sort of poor-mans-backup solution, and am now seeing very slow update checks.

adrianvg commented Apr 7, 2016

@guruz;
Are there any nightly builds for CentOS 7 available as well?
I took the (maybe premature) step to move my local homefolder to Owncloud to get a sort of poor-mans-backup solution, and am now seeing very slow update checks.

@dragotin

This comment has been minimized.

Show comment
Hide comment
@adrianvg

This comment has been minimized.

Show comment
Hide comment
@adrianvg

adrianvg Apr 7, 2016

I must be going blind...
Thanks @dragotin !

adrianvg commented Apr 7, 2016

I must be going blind...
Thanks @dragotin !

@mislav-eu

This comment has been minimized.

Show comment
Hide comment
@mislav-eu

mislav-eu Jun 15, 2016

Why is this closed if it's not fixed? There is still issue with small file uploading - even on 9.0.2. - as mentioned above, bigger file upload is not the problem, but small file upload.

I've tried to upload through my linux network drive, mapping the same in windows machine, WinSCP - it's slow, very slow. There are no errors in logs, just slow speed - in bytes!!!

I've created few hundred of files of size in range of 10-1000kB and always the same problem. I've also tried setting as suggested "innodb_flush_log_at_trx_commit = 2" but that didn't help. We also changed disks, also no luck.

Any idea how to proceed? It's making a huge problem for us/clients.

Why is this closed if it's not fixed? There is still issue with small file uploading - even on 9.0.2. - as mentioned above, bigger file upload is not the problem, but small file upload.

I've tried to upload through my linux network drive, mapping the same in windows machine, WinSCP - it's slow, very slow. There are no errors in logs, just slow speed - in bytes!!!

I've created few hundred of files of size in range of 10-1000kB and always the same problem. I've also tried setting as suggested "innodb_flush_log_at_trx_commit = 2" but that didn't help. We also changed disks, also no luck.

Any idea how to proceed? It's making a huge problem for us/clients.

@PVince81

This comment has been minimized.

Show comment
Hide comment
@PVince81

PVince81 Jun 15, 2016

Member

@mislav-eu it's likely closed because the slowness is on a case by case basis. For one person it can be environment issue A. For another it's environment issue B. For some people and environments it's not a problem at all.

In your case need to find out what environment you are using so best would be to make a new report using the issue template: https://raw.githubusercontent.com/owncloud/core/master/issue_template.md

I assume that you already checked https://owncloud.org/support/ or the forums for known environment issues that would cause upload slowness ?

Member

PVince81 commented Jun 15, 2016

@mislav-eu it's likely closed because the slowness is on a case by case basis. For one person it can be environment issue A. For another it's environment issue B. For some people and environments it's not a problem at all.

In your case need to find out what environment you are using so best would be to make a new report using the issue template: https://raw.githubusercontent.com/owncloud/core/master/issue_template.md

I assume that you already checked https://owncloud.org/support/ or the forums for known environment issues that would cause upload slowness ?

@mislav-eu

This comment has been minimized.

Show comment
Hide comment
@mislav-eu

mislav-eu Jun 15, 2016

I will open then new report. But yes, mostly people have the same problem:
https://forum.owncloud.org/viewtopic.php?t=17477
https://forum.owncloud.org/viewtopic.php?t=30083

I've tried mentioned things, but no result.

mislav-eu commented Jun 15, 2016

I will open then new report. But yes, mostly people have the same problem:
https://forum.owncloud.org/viewtopic.php?t=17477
https://forum.owncloud.org/viewtopic.php?t=30083

I've tried mentioned things, but no result.

@PVince81

This comment has been minimized.

Show comment
Hide comment
@PVince81

PVince81 Jun 15, 2016

Member

During the upload of small files there is no chunking involved, so no chunk assembly.

This means that in most cases the file is directly streaming by Apache to PHP and PHP passes it to the ownCloud code which stream-copies it into a part file. Then the part file gets renamed to the final file. So the part where the bytes are copied should be optimal.
Now if there's encryption in the middle it can be a little slower because the stream copy also encrypts every block.

So the slowness could be due to the stream copying from the web server to PHP being slow. Some web servers even create a temporary file before streaming the file to ownCloud (seen it happening with some nginx settings).

Then the other part which could be slow is setting up the network connection and later on PHP setting up its internal filesystem, but this happens before the stream copy. So the question is whether the transfer speed values are based on the stream copy part or whether they look lower (averaged?) because the start of the transfer was slower.

Also to check if whether the target folder is a received shared folder, and whether that one was reshared. If the target folder is on external storage, it will likely be much slower due to the extra upload to the external storage.

Member

PVince81 commented Jun 15, 2016

During the upload of small files there is no chunking involved, so no chunk assembly.

This means that in most cases the file is directly streaming by Apache to PHP and PHP passes it to the ownCloud code which stream-copies it into a part file. Then the part file gets renamed to the final file. So the part where the bytes are copied should be optimal.
Now if there's encryption in the middle it can be a little slower because the stream copy also encrypts every block.

So the slowness could be due to the stream copying from the web server to PHP being slow. Some web servers even create a temporary file before streaming the file to ownCloud (seen it happening with some nginx settings).

Then the other part which could be slow is setting up the network connection and later on PHP setting up its internal filesystem, but this happens before the stream copy. So the question is whether the transfer speed values are based on the stream copy part or whether they look lower (averaged?) because the start of the transfer was slower.

Also to check if whether the target folder is a received shared folder, and whether that one was reshared. If the target folder is on external storage, it will likely be much slower due to the extra upload to the external storage.

@mislav-eu

This comment has been minimized.

Show comment
Hide comment
@mislav-eu

mislav-eu Jun 15, 2016

Dear @PVince81 - I will create separated report for this. #25115

Dear @PVince81 - I will create separated report for this. #25115

@PVince81

This comment has been minimized.

Show comment
Hide comment
Member

PVince81 commented Jun 15, 2016

@mislav-eu thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment