Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

corruption cleanup? #3173

Closed
stanelie opened this issue Jan 19, 2017 · 2 comments
Closed

corruption cleanup? #3173

stanelie opened this issue Jan 19, 2017 · 2 comments
Labels
0. Needs triage Pending check for reproducibility or if it fits our roadmap bug feature: external storage feature: filesystem

Comments

@stanelie
Copy link

Steps to reproduce

  1. Setup a sync folder from a SMB share in the Nextcloud client
  2. Wait for it to sync

Expected behaviour

It should sync to the local computer, and I expect the client to keep going even if it encounters an error, and give me a detailed report as to what I should do to correct the error

Actual behaviour

The client gives a "internal server error" error message or An error has occured, operation canceled" or "missing file"and never finishes syncing the folder.

Bonus info

It occurred to me that the file listing inside nextcloud might not match the actual files on the attached smb shares. So, I tried to do a
sudo -u www-data php occ files:scan --path="mrpotato/files/_Budget" on a smb share for one user to see if it would correct. I stopped it after 20 minutes running and it said this :
+---------+-------+--------------+ | Folders | Files | Elapsed time | +---------+-------+--------------+ | 1 | 5 | 00:20:53 | +---------+-------+--------------+
Is this expected behavior? 5 files scanned in 20 minutes?
Also, I notice that the table oc_filecache has 1203617 rows. Looks big to me (about 600GB of files from SMB storage attached to nextcloud). Not sure if this is relevant.

Server configuration

Operating system:
Ubuntu 14.04.5 LTS
Web server:
Apache/2.4.7 (Ubuntu)
Database:
mysql Ver 14.14 Distrib 5.5.53, for debian-linux-gnu (x86_64) using readline 6.3
PHP version:
PHP Version 5.6.29-1+deb.sury.org~trusty+1
Nextcloud version: (see Nextcloud admin page)
11.0.1 (stable)
Updated from an older Nextcloud/ownCloud or fresh install:
Updated
Where did you install Nextcloud from:
The internet
Signing status:

Signing status
No errors have been found.

List of activated apps:

App list
  - activity: 2.4.1
  - admin_audit: 1.1.0
  - audioplayer: 1.4.0
  - calendar: 1.5.0
  - comments: 1.1.0
  - contacts: 1.5.2
  - dav: 1.1.1
  - federatedfilesharing: 1.1.1
  - federation: 1.1.1
  - files: 1.6.1
  - files_downloadactivity: 1.0.0
  - files_external: 1.1.2
  - files_pdfviewer: 1.0.1
  - files_retention: 1.0.1
  - files_sharing: 1.1.1
  - files_texteditor: 2.2
  - files_trashbin: 1.1.0
  - files_versions: 1.4.0
  - files_videoplayer: 1.0.0
  - firstrunwizard: 2.0
  - gallery: 16.0.0
  - logreader: 2.0.0
  - lookup_server_connector: 1.0.0
  - nextcloud_announcements: 1.0
  - notifications: 1.0.1
  - password_policy: 1.1.0
  - provisioning_api: 1.1.0
  - serverinfo: 1.1.1
  - sharebymail: 1.0.1
  - survey_client: 0.1.5
  - systemtags: 1.1.3
  - templateeditor: 0.2
  - theming: 1.1.1
  - twofactor_backupcodes: 1.0.0
  - updatenotification: 1.1.1
  - user_ldap: 1.1.1
  - workflowengine: 1.1.1
Disabled:
  - documents
  - encryption
  - external
  - files_accesscontrol
  - files_automatedtagging
  - files_mv
  - tasks
  - user_external
  - user_saml

The content of config/config.php:

Config report
{
    "system": {
        "instanceid": "och3seedqlz1",
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": [
            "***REMOVED SENSITIVE VALUE***",
            "192.168.0.38",
            "192.168.0.2",
            "***REMOVED SENSITIVE VALUE***",
        ],
        "datadirectory": "\/var\/www\/owncloud\/data",
        "overwrite.cli.url": "https:\/\/***REMOVED SENSITIVE VALUE***",
        "dbtype": "mysql",
        "version": "11.0.1.2",
        "dbname": "owncloud",
        "dbhost": "localhost",
        "dbtableprefix": "oc_",
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "logtimezone": "America\/New_York",
        "installed": true,
        "forcessl": true,
        "overwriteprotocol": "https",
        "mail_smtpmode": "smtp",
        "mail_smtphost": "relais.videotron.ca",
        "mail_from_address": "owncloud",
        "mail_domain": "***REMOVED SENSITIVE VALUE***",
        "ldapIgnoreNamingRules": false,
        "loglevel": 2,
        "memcache.local": "\\OC\\Memcache\\Redis",
        "redis": {
            "host": "localhost",
            "port": 6379
        },
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "theme": "exm",
        "preview_libreoffice_path": "\/usr\/bin\/libreoffice",
        "updatechecker": true,
        "maintenance": false,
        "default_language": "fr",
        "appstore.experimental.enabled": true,
        "htaccess.RewriteBase": "\/",
        "ldapProviderFactory": "\\OCA\\User_LDAP\\LDAPProviderFactory",
        "trusted_proxies": [
            "192.168.0.2"
        ],
        "updater.release.channel": "stable",
        "updater.secret": "***REMOVED SENSITIVE VALUE***"
    }
}

Are you using external storage, if yes which one: local/smb/sftp/...
SMB
Are you using encryption: yes/no
no
Are you using an external user-backend, if yes which one: LDAP/ActiveDirectory/Webdav/...
ActiveDirectory

LDAP configuration (delete this part if not used)

LDAP config
+-------------------------------+-------------------------------------------------------------------------------------------------------                                     ---------------------------------------------------------------------------+
| Configuration                 |                                                                                                                                                                                                                       |
+-------------------------------+-------------------------------------------------------------------------------------------------------                                     ---------------------------------------------------------------------------+
| hasMemberOfFilterSupport      | 1                                                                                                                                                                                                                     |
| hasPagedResultSupport         |                                                                                                                                                                                                                       |
| homeFolderNamingRule          | attr:sAMAccountName                                                                                                                                                                                                   |
| lastJpegPhotoLookup           | 0                                                                                                                                                                                                                     |
| ldapAgentName                 | CN=owncloud,OU=equipmentusers,OU=SBSUsers,OU=Users,OU=MyBusiness,DC=caserne                                                                                                                                           |
| ldapAgentPassword             | ***                                                                                                                                                                                                                   |
| ldapAttributesForGroupSearch  |                                                                                                                                                                                                                       |
| ldapAttributesForUserSearch   |                                                                                                                                                                                                                       |
| ldapBackupHost                |                                                                                                                                                                                                                       |
| ldapBackupPort                |                                                                                                                                                                                                                       |
| ldapBase                      | DC=caserne                                                                                                                                                                                                            |
| ldapBaseGroups                | DC=caserne                                                                                                                                                                                                            |
| ldapBaseUsers                 | DC=caserne                                                                                                                                                                                                            |
| ldapCacheTTL                  | 600                                                                                                                                                                                                                   |
| ldapConfigurationActive       | 1                                                                                                                                                                                                                     |
| ldapDynamicGroupMemberURL     |                                                                                                                                                                                                                       |
| ldapEmailAttribute            | mail                                                                                                                                                                                                                  |
| ldapExperiencedAdmin          | 0                                                                                                                                                                                                                     |
| ldapExpertUUIDGroupAttr       | sAMAccountName                                                                                                                                                                                                        |
| ldapExpertUUIDUserAttr        | samaccountname                                                                                                                                                                                                        |
| ldapExpertUsernameAttr        | samaccountname                                                                                                                                                                                                        |
| ldapGroupDisplayName          | samaccountname                                                                                                                                                                                                        |
| ldapGroupFilter               | (|(cn=owncloud_users)(cn=BUDGETS)(cn=COMMUNICATION)(cn=MBVL)(cn=PRODUCTIONS)(cn=TECHNIQUE)(cn=R&D)(cn=                                     budget_prod))                                                              |
| ldapGroupFilterGroups         | owncloud_users;BUDGETS;COMMUNICATION;MBVL;PRODUCTIONS;TECHNIQUE;R&D;budget_prod                                                                                                                                       |
| ldapGroupFilterMode           | 0                                                                                                                                                                                                                     |
| ldapGroupFilterObjectclass    |                                                                                                                                                                                                                       |
| ldapGroupMemberAssocAttr      | uniqueMember                                                                                                                                                                                                          |
| ldapHost                      | caserne1                                                                                                                                                                                                              |
| ldapIgnoreNamingRules         |                                                                                                                                                                                                                       |
| ldapLoginFilter               | (&(&(|(objectclass=person))(|(|(memberof=CN=owncloud_users,OU=Security Groups,OU=MyBusiness,DC=caserne                                     )(primaryGroupID=5259))))(|(samaccountname=%uid)(|(sAMAccountName=%uid)))) |
| ldapLoginFilterAttributes     | sAMAccountName                                                                                                                                                                                                        |
| ldapLoginFilterEmail          | 0                                                                                                                                                                                                                     |
| ldapLoginFilterMode           | 0                                                                                                                                                                                                                     |
| ldapLoginFilterUsername       | 1                                                                                                                                                                                                                     |
| ldapNestedGroups              | 0                                                                                                                                                                                                                     |
| ldapOverrideMainServer        |                                                                                                                                                                                                                       |
| ldapPagingSize                | 500                                                                                                                                                                                                                   |
| ldapPort                      | 389                                                                                                                                                                                                                   |
| ldapQuotaAttribute            |                                                                                                                                                                                                                       |
| ldapQuotaDefault              |                                                                                                                                                                                                                       |
| ldapTLS                       | 0                                                                                                                                                                                                                     |
| ldapUserDisplayName           | displayName                                                                                                                                                                                                           |
| ldapUserDisplayName2          |                                                                                                                                                                                                                       |
| ldapUserFilter                | (&(|(objectclass=person))(|(|(memberof=CN=owncloud_users,OU=Security Groups,OU=MyBusiness,DC=caserne)(                                     primaryGroupID=5259))))                                                    |
| ldapUserFilterGroups          | owncloud_users                                                                                                                                                                                                        |
| ldapUserFilterMode            | 0                                                                                                                                                                                                                     |
| ldapUserFilterObjectclass     | person                                                                                                                                                                                                                |
| ldapUuidGroupAttribute        | auto                                                                                                                                                                                                                  |
| ldapUuidUserAttribute         | auto                                                                                                                                                                                                                  |
| turnOffCertCheck              | 0                                                                                                                                                                                                                     |
| turnOnPasswordChange          | 0                                                                                                                                                                                                                     |
| useMemberOfToDetectMembership | 1                                                                                                                                                                                                                     |
+-------------------------------+-------------------------------------------------------------------------------------------------------                                     ---------------------------------------------------------------------------+

Client configuration

Browser:
N/A
Operating system:
windows 7 64bits

Logs

Web server error log

Web server error log ``` no errors ```

Nextcloud log (data/nextcloud.log)

Nextcloud log ``` {"reqId":"BEVrjWH8QLG\/9Nc7uPiB","remoteAddr":"24.37.113.93","app":"webdav","message":"Exception: {\"Message\":\"Invalid request for \\\/Copie de Budgets - MCLAREN NBOC VLC.xlsm (NotFoundException)\",\"Exception\":\"Icewind\\\\SMB\\\\Exception\\\\NotFoundException\",\"Code\":0,\"Trace\":\"#0 \\\/var\\\/www\\\/owncloud\\\/apps\\\/files_external\\\/3rdparty\\\/icewind\\\/smb\\\/src\\\/Share.php(398): Icewind\\\\SMB\\\\Parser->checkForError(Array, '\\\/Copie de Budge...')\\n#1 \\\/var\\\/www\\\/owncloud\\\/apps\\\/files_external\\\/3rdparty\\\/icewind\\\/smb\\\/src\\\/Share.php(140): Icewind\\\\SMB\\\\Share->parseOutput(Array, '\\\/Copie de Budge...')\\n#2 \\\/var\\\/www\\\/owncloud\\\/apps\\\/files_external\\\/lib\\\/Lib\\\/Storage\\\/SMB.php(129): Icewind\\\\SMB\\\\Share->stat('\\\/Copie de Budge...')\\n#3 \\\/var\\\/www\\\/owncloud\\\/apps\\\/files_external\\\/lib\\\/Lib\\\/Storage\\\/SMB.php(171): OCA\\\\Files_External\\\\Lib\\\\Storage\\\\SMB->getFileInfo('Copie de Budget...')\\n#4 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Storage\\\/Common.php(175): OCA\\\\Files_External\\\\Lib\\\\Storage\\\\SMB->stat('Copie de Budget...')\\n#5 \\\/var\\\/www\\\/owncloud\\\/apps\\\/files_external\\\/lib\\\/Lib\\\/Storage\\\/SMB.php(230): OC\\\\Files\\\\Storage\\\\Common->filemtime('Copie de Budget...')\\n#6 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Storage\\\/Wrapper\\\/Wrapper.php(374): OCA\\\\Files_External\\\\Lib\\\\Storage\\\\SMB->hasUpdated('Copie de Budget...', 1484851887)\\n#7 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Storage\\\/Wrapper\\\/Availability.php(395): OC\\\\Files\\\\Storage\\\\Wrapper\\\\Wrapper->hasUpdated('Copie de Budget...', 1484851887)\\n#8 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Storage\\\/Wrapper\\\/Wrapper.php(374): OC\\\\Files\\\\Storage\\\\Wrapper\\\\Availability->hasUpdated('Copie de Budget...', 1484851887)\\n#9 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Storage\\\/Wrapper\\\/Wrapper.php(374): OC\\\\Files\\\\Storage\\\\Wrapper\\\\Wrapper->hasUpdated('Copie de Budget...', 1484851887)\\n#10 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Storage\\\/Wrapper\\\/Wrapper.php(374): OC\\\\Files\\\\Storage\\\\Wrapper\\\\Wrapper->hasUpdated('Copie de Budget...', 1484851887)\\n#11 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Watcher.php(126): OC\\\\Files\\\\Storage\\\\Wrapper\\\\Wrapper->hasUpdated('Copie de Budget...', 1484851887)\\n#12 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/View.php(1304): OC\\\\Files\\\\Cache\\\\Watcher->needsUpdate('Copie de Budget...', Object(OC\\\\Files\\\\Cache\\\\CacheEntry))\\n#13 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/View.php(1342): OC\\\\Files\\\\View->getCacheEntry(Object(OCA\\\\Files_Trashbin\\\\Storage), 'Copie de Budget...', '_budget_operas\\\/...')\\n#14 \\\/var\\\/www\\\/owncloud\\\/apps\\\/dav\\\/lib\\\/Connector\\\/Sabre\\\/ObjectTree.php(160): OC\\\\Files\\\\View->getFileInfo('_budget_operas\\\/...')\\n#15 \\\/var\\\/www\\\/owncloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/CorePlugin.php(81): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\ObjectTree->getNodeForPath('_budget_operas\\\/...')\\n#16 [internal function]: Sabre\\\\DAV\\\\CorePlugin->httpGet(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#17 \\\/var\\\/www\\\/owncloud\\\/3rdparty\\\/sabre\\\/event\\\/lib\\\/EventEmitterTrait.php(105): call_user_func_array(Array, Array)\\n#18 \\\/var\\\/www\\\/owncloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(479): Sabre\\\\Event\\\\EventEmitter->emit('method:GET', Array)\\n#19 \\\/var\\\/www\\\/owncloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(254): Sabre\\\\DAV\\\\Server->invokeMethod(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#20 \\\/var\\\/www\\\/owncloud\\\/apps\\\/dav\\\/appinfo\\\/v1\\\/webdav.php(60): Sabre\\\\DAV\\\\Server->exec()\\n#21 \\\/var\\\/www\\\/owncloud\\\/remote.php(165): require_once('\\\/var\\\/www\\\/ownclo...')\\n#22 {main}\",\"File\":\"\\\/var\\\/www\\\/owncloud\\\/apps\\\/files_external\\\/3rdparty\\\/icewind\\\/smb\\\/src\\\/Parser.php\",\"Line\":57,\"User\":\"mrpotato\"}","level":4,"time":"2017-01-19T13:56:57-05:00","method":"GET","url":"\/remote.php\/webdav\/_budget_operas\/Copie%20de%20Budgets%20-%20MCLAREN%20NBOC%20VLC.xlsm","user":"mrpotato","version":"11.0.1.2"} root@owncloud:/var/www/owncloud/data# ```

Browser log

Browser log ``` Insert your browser log here, this could for example include:

a) The javascript console log
b) The network log
c) ...

</details>
@nickvergessen
Copy link
Member

@icewind1991

@MorrisJobke MorrisJobke added 0. Needs triage Pending check for reproducibility or if it fits our roadmap bug labels Jul 27, 2017
@nextcloud-bot nextcloud-bot added the stale Ticket or PR with no recent activity label Jun 20, 2018
@skjnldsv skjnldsv removed stale Ticket or PR with no recent activity labels Jun 12, 2019
@skjnldsv
Copy link
Member

As the version of the software you've reported this for has reached end of life, I will close this ticket. If this is still happening after an upgrade to the latest version, feel free to reopen

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
0. Needs triage Pending check for reproducibility or if it fits our roadmap bug feature: external storage feature: filesystem
Projects
None yet
Development

No branches or pull requests

5 participants