Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Filesystem and cache inconsistent #2364

Closed
voidzero opened this issue Mar 15, 2013 · 11 comments

Comments

@voidzero
Copy link

commented Mar 15, 2013

With OC5 I am getting a lot of inconsistencies, and there is no rescan app anymore? Maybe this happened when the cache was updating after my upgrade from 4.5.7 to 5.0?

edit Yeah, it's so bad, it's not even usable anymore.

@tomvlk

This comment has been minimized.

Copy link

commented Mar 15, 2013

Having same issues. Some files disappear from the webinterface and clients, but they are still in the 'real filesystem'.
We need a solution for this before everyone is getting this when upgrading.

@BernhardPosselt

This comment has been minimized.

Copy link
Contributor

commented Mar 16, 2013

@pvdh

This comment has been minimized.

Copy link

commented Mar 16, 2013

Same issue here. OS is current Debian, some folders are shown in the file app, but all of them are empty. Some "new" files like "SF20130208-2678.jpg" appear, but trying to access them results in erros.
When I construct a missing folder "by hand", I can access it fine.

@MTGap

This comment has been minimized.

Copy link
Contributor

commented Mar 16, 2013

@voidzero

This comment has been minimized.

Copy link
Author

commented Mar 17, 2013

I don't see what more info you require @MTGap, so I'm not sure what to supply beyond what I already said.

The issue is that the files in the filesystem are not in sync with OC's filesystem cache. OC shows directories that aren't there, and it seems to mess up shared folders too. When I enter those folders they are empty.

There's nothing usable in the logs, if it's possible to rescan the files then all would be alright I suppose?

It would make sense if the part that re-scans all files during upgrade process is the culprit, but like I said, the logs don't help me any further and I can't reproduce the issue, I'm just stuck with an out-of-date owncloud installation that I'd rather not have to build up again from scratch if this can be fixed.

I wish I could make this all sound less urgent because I am a humble OC enthousiast, but I was relying on this software and the files portion did just break, rendering files unaccessible.

@MTGap

This comment has been minimized.

Copy link
Contributor

commented Mar 17, 2013

I believe the file cache is quite robust in ownCloud 5 so I want to place blame on the upgrade and old file cache. You can empty the filecache and storages tables to trigger a rescan.

If files show up that don't exist, your old file cache may have been corrupted.

@pvdh

This comment has been minimized.

Copy link

commented Mar 18, 2013

Expected behaviour

Files that exist in owncloud/data/user should be accessible with webdav or the files-app.
Files that do not exist should not show up in webdav or the files-app.
Files that never even existed should not show up.

Actual behaviour

Some directories are missing when using the files-app or webdav on the root-folder, e.g. "clientsync". However, if I manipulate the url in my browser directly (by adding "?dir=//clientsync" to "owncloud/index.php/apps/files", I can access clientsync without any issues.

About 40 files like "SF20130208-2678.jpg" show up in the root-folder, but any attempt to access them (via the app or via webdav) fails.

Some directories are just empty via webdav or the files-app, but contain files when I look at my webservers data-directory directly.

Steps to reproduce

I can't reproduce this issue.

Server configuration

Operating system: current debian

Web server: apache 2.2.16-6+squeeze10

Database: mysql 5.1.66-0+squeeze1

PHP version: php5 5.3.3-7+squeeze14

ownCloud version: 5.0

Client configuration

Browser: firefox or google chrome, current releases

Operating system: Debian Linux, Fedora Linux, Windows 7

Logs

Web server error log

no errors related to owncloud

ownCloud log (data/owncloud.log)

lots of lines like:

{"app":"core","message":"Can't get cache storage, user not logged in","level":3,"time":1361867971}
{"app":"PHP","message":"Undefined index: artist at /var/www/ssl/owncloud/apps/media/lib/scanner.php#74","level":2,"time":1363537835}
{"app":"PHP","message":"Undefined index: album at /var/www/ssl/owncloud/apps/media/lib/scanner.php#75","level":2,"time":1363537835}
{"app":"PHP","message":"Undefined index: title at /var/www/ssl/owncloud/apps/media/lib/scanner.php#77","level":2,"time":1363537835}
{"app":"PHP","message":"Undefined index: length at /var/www/ssl/owncloud/apps/media/lib/scanner.php#77","level":2,"time":1363537835}
{"app":"PHP","message":"Undefined index: track at /var/www/ssl/owncloud/apps/media/lib/scanner.php#77","level":2,"time":1363537835}
{"app":"PHP","message":"Undefined index: size at /var/www/ssl/owncloud/apps/media/lib/scanner.php#77","level":2,"time":1363537835}

and lots of issues regarding Calendar or Contacts, which should not apply here.

By the way, there are messages like
{"app":"search_lucene","message":"failed to extract meta information for /clientsync/....~pbqm1c: unable to determine file format","level":2,"time":1363484397}
which clearly indicate that search_lucene is aware of directories and files which are missing in webdav or the files-app.

I'm especially worried about some LDAP-errors, but the LDAP-backend works fine anyway.

{"app":"user_ldap","message":"Configuration is invalid, cannot connect","level":2,"time":1363535351}
{"app":"user_ldap","message":"Connection could not be established","level":3,"time":1363535351}
{"app":"user_ldap","message":"bgJ "updateGroups" \u2013 groups do not seem to be configured properly, aborting.","level":1,"time":1363535351}
{"app":"user_ldap","message":"Configuration is invalid, cannot connect","level":2,"time":1363539251}
{"app":"user_ldap","message":"Connection could not be established","level":3,"time":1363539251}
{"app":"user_ldap","message":"bgJ "updateGroups" \u2013 groups do not seem to be configured properly, aborting.","level":1,"time":1363539251}
{"app":"PHP","message":"filemtime(): stat failed for /var/www/ssl/owncloud/data/patrick@wudika.de/files/Griechenland/asdf at /var/www/ssl/owncloud/lib/files/storage/local.php#92","level":2,"time":1363539364}
{"app":"user_ldap","message":"Configuration is invalid, cannot connect","level":2,"time":1363547085}
{"app":"user_ldap","message":"Connection could not be established","level":3,"time":1363547085}
{"app":"user_ldap","message":"bgJ "updateGroups" \u2013 groups do not seem to be configured properly, aborting.","level":1,"time":1363547085}
{"app":"user_ldap","message":"Configuration is invalid, cannot connect","level":2,"time":1363567247}
{"app":"user_ldap","message":"Connection could not be established","level":3,"time":1363567247}
{"app":"user_ldap","message":"bgJ "updateGroups" \u2013 groups do not seem to be configured properly, aborting.","level":1,"time":1363567247}

Regarding the cache I find lots of messages like
{"app":"core","message":"Can't get cache storage, user not logged in","level":3,"time":1361868229}
but that happend several days before my update.

Browser log

I do not bother with the browser log, sinde the issues exists with webdav as well, so the usual suspects like javascript or CSS don't apply.

@voidzero

This comment has been minimized.

Copy link
Author

commented Mar 18, 2013

In my postgresql database, I ran these two commands:

DELETE FROM filecache;
DELETE FROM storages;

That seems to have solved it, thanks!

@tomvlk

This comment has been minimized.

Copy link

commented Mar 18, 2013

That solved the problem for me too. Thanks.

@voidzero voidzero closed this Mar 18, 2013

@zeugmatis

This comment has been minimized.

Copy link

commented Mar 20, 2013

This did work for me too, in mysql:

DELETE FROM oc_filecache;
DELETE FROM oc_storages;

...then typed "a" in the OC search box when in files and it gave status file count while it rebuilt the index.
However still not showing files in the media player but that looks to be separate issue #734

@a-schild

This comment has been minimized.

Copy link

commented Jun 4, 2013

Deleting oc_storages will wipe shares!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
7 participants
You can’t perform that action at this time.