Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OCC does not see S3 directory when created via AWS CLI #30761

Closed
ghost opened this issue Mar 13, 2018 · 5 comments
Closed

OCC does not see S3 directory when created via AWS CLI #30761

ghost opened this issue Mar 13, 2018 · 5 comments

Comments

@ghost
Copy link

ghost commented Mar 13, 2018

Steps to reproduce

  1. Install AWS CLI for python:
    pip install awscli
  2. Configure AWS CLI
    aws configure
  3. Create temp dir and copy it to s3
    mkdir /tmp/test ; echo 123 > /tmp/test/1
    aws s3 cp /tmp/test s3:///test --recursive
  4. Run OCC
    sudo -u php-fpm occ files:scan --path=/admin/files/AmazonS3/ -vvv

Expected behaviour

OCC should return all directories in bucket

Actual behaviour

When using aws cli to copy directory to s3 bucket, OCC does not see it while using files:scan.
However when I access AWS CONSOLE (website), create directory and upload files - OCC can see it.

Server configuration

CentOS 7

Web server:
Nginx

Database:
Default

PHP version:
56u (IUS)

ownCloud version: (see ownCloud admin page)
10.0.4

Updated from an older ownCloud or fresh install:
Fresh

Where did you install ownCloud from:
Official source

Signing status (ownCloud 9.0 and above):

No errors have been found.

The content of config/config.php:

{
"system": {
"updatechecker": false,
"instanceid": "ocdv9dkx8l66",
"passwordsalt": "REMOVED SENSITIVE VALUE",
"secret": "REMOVED SENSITIVE VALUE",
"trusted_domains": [
"example.com:10080"
],
"datadirectory": "/var/www/owncloud/data",
"overwrite.cli.url": "https://example.com10080",
"dbtype": "sqlite3",
"version": "10.0.4.4",
"logtimezone": "UTC",
"installed": true
}
}

List of activated apps:

Enabled:

  • comments: 0.3.0
  • configreport: 0.1.1
  • dav: 0.3.2
  • federatedfilesharing: 0.3.1
  • federation: 0.1.0
  • files: 1.5.1
  • files_external: 0.7.1
  • files_sharing: 0.10.1
  • files_trashbin: 0.9.1
  • files_versions: 1.3.0
  • files_videoplayer: 0.9.8
  • firstrunwizard: 1.1
  • market: 0.2.3
  • notifications: 0.3.2
  • provisioning_api: 0.5.0
  • systemtags: 0.3.0
  • templateeditor: 0.1
  • updatenotification: 0.2.1
    Disabled:
  • encryption
  • external
  • theme-example
  • user_external

Are you using external storage, if yes which one: local/smb/sftp/...
S3

Are you using encryption: yes/no
NO

Are you using an external user-backend, if yes which one: LDAP/ActiveDirectory/Webdav/...
No

Client configuration

Browser:
Chrome

Operating system:
Fedora 27

Logs

Web server error log

None

ownCloud log (data/owncloud.log)

Exception during scan: ErrorException: Undefined index: size
#0 /var/www/owncloud/lib/private/Files/Cache/Scanner.php(421): OCA\Files\Command\Scan->exceptionErrorHandler(8, 'Undefined index...', '/var/www/ownclo...', 421, Array)
#1 /var/www/owncloud/lib/private/Files/Cache/Scanner.php(382): OC\Files\Cache\Scanner->handleChildren('', true, 3, '16', true, 299044)
#2 /var/www/owncloud/lib/private/Files/Cache/Scanner.php(316): OC\Files\Cache\Scanner->scanChildren('', true, 3, 16, true)
#3 /var/www/owncloud/lib/private/Files/Utils/Scanner.php(238): OC\Files\Cache\Scanner->scan('', true, 3)
#4 /var/www/owncloud/apps/files/lib/Command/Scan.php(224): OC\Files\Utils\Scanner->scan('/admin/files/Am...', false)
#5 /var/www/owncloud/apps/files/lib/Command/Scan.php(310): OCA\Files\Command\Scan->scanFiles('admin', '/admin/files/Am...', true, Object(Symfony\Component\Console\Output\ConsoleOutput), false, false)
#6 /var/www/owncloud/lib/composer/symfony/console/Command/Command.php(262): OCA\Files\Command\Scan->execute(Object(Symfony\Component\Console\Input\ArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#7 /var/www/owncloud/core/Command/Base.php(159): Symfony\Component\Console\Command\Command->run(Object(Symfony\Component\Console\Input\ArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#8 /var/www/owncloud/lib/composer/symfony/console/Application.php(826): OC\Core\Command\Base->run(Object(Symfony\Component\Console\Input\ArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#9 /var/www/owncloud/lib/composer/symfony/console/Application.php(189): Symfony\Component\Console\Application->doRunCommand(Object(OCA\Files\Command\Scan), Object(Symfony\Component\Console\Input\ArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#10 /var/www/owncloud/lib/composer/symfony/console/Application.php(120): Symfony\Component\Console\Application->doRun(Object(Symfony\Component\Console\Input\ArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#11 /var/www/owncloud/lib/private/Console/Application.php(162): Symfony\Component\Console\Application->run(NULL, NULL)
#12 /var/www/owncloud/console.php(106): OC\Console\Application->run()
#13 /var/www/owncloud/occ(11): require_once('/var/www/ownclo...')
#14 {main}

Browser log

None

@ownclouders
Copy link
Contributor

GitMate.io thinks the contributor most likely able to help you is @PVince81.

Possibly related issues are #10803 (Cannot create data directory), #24713 (AWS S3 doesn't work in S3), #15054 (occ failes as cli), #25755 (home storage not writable), and #29812 (Cannot occ scan repair for a particular user).

@DeepDiver1975
Copy link
Member

known issue - please see https://github.com/owncloud/files_external_s3

@ghost
Copy link
Author

ghost commented Mar 13, 2018

@DeepDiver1975 when I install it i get :
"- Signature data not found."

@DeepDiver1975
Copy link
Member

The issue is not yet solved - this is the correct link owncloud/files_external_s3#7

@lock
Copy link

lock bot commented Jul 30, 2019

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.

@lock lock bot locked as resolved and limited conversation to collaborators Jul 30, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

2 participants