Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update reva to v1.4.1-0.20201118150422-667197a6b674 #823

Conversation

butonic
Copy link
Member

@butonic butonic commented Nov 9, 2020

Update reva to v1.4.1-0.20201123062044-b2c4af4e897d

@butonic butonic force-pushed the update-reva-to-v1.3.1-0.20201109104617-f47d01b73dec branch 2 times, most recently from 17bac11 to d097f0f Compare November 10, 2020 14:50
@phil-davis
Copy link
Contributor

CI in master should be improved now. A rebase here might make CI happy.

@butonic butonic force-pushed the update-reva-to-v1.3.1-0.20201109104617-f47d01b73dec branch from d097f0f to 2e8522a Compare November 11, 2020 09:01
@butonic
Copy link
Member Author

butonic commented Nov 11, 2020

so it seems the tests cannot create users:

Background:                                                                              # /drone/src/ocis/tests/acceptance/features/apiOcisSpecific/apiAuthOcs-ocsGETAuth.feature:4 | 21s
-- | --
324 | Given user "Alice" has been created with default attributes and without skeleton files # FeatureContext::userHasBeenCreatedWithDefaultAttributesAndWithoutSkeletonFiles() | 21s
325 | Provisioning::usersHaveBeenCreated Received empty response where XML was expected (Exception)

after starting ocis with PROXY_ENABLE_BASIC_AUTH=true OCIS_LOG_LEVEL=debug go run cmd/ocis/main.go server I can create a new user with

curl -X POST 'https://localhost:9200/ocs/v2.php/cloud/users' -k -i -u admin:admin -d userid="brand-new-user" -d password="123" -d email="brand-new-user@example.org" 
HTTP/1.1 200 OK
Access-Control-Allow-Origin: *
Cache-Control: no-cache, no-store, max-age=0, must-revalidate, value
Content-Length: 371
Content-Type: application/xml; charset=utf-8
Date: Wed, 11 Nov 2020 09:54:24 GMT
Expires: Thu, 01 Jan 1970 00:00:00 GMT
Last-Modified: Wed, 11 Nov 2020 09:54:24 GMT
Ocs-Api-Version: 2
X-Content-Type-Options: nosniff
X-Frame-Options: DENY
X-Ocs-Version: 0.0.0
X-Xss-Protection: 1; mode=block

<?xml version="1.0" encoding="UTF-8"?>
<ocs><meta><status>ok</status><statuscode>200</statuscode><message>OK</message></meta><data><enabled>true</enabled><id>brand-new-user</id><display-name>brand-new-user</display-name><displayname>brand-new-user</displayname><email>brand-new-user@example.org</email><uidnumber>20005</uidnumber><gidnumber>30000</gidnumber></data></ocs>%

It gives me a 200 OK ...

but in the ocis log I see an error related to uploads ...

2020-11-11T10:54:24+01:00 ERR error uploading file error="ocisfs: error retrieving upload: open /var/tmp/ocis/metadata/uploads/accounts/brand-new-user.info: no such file or directory" pkg=rhttp service=storage traceid=add5f17e5ec6c6eaa5a523a8752c8c53
2020-11-11T10:54:24+01:00 ERR http end="11/Nov/2020:10:54:24 +0100" host=::1 method=PUT pkg=rhttp proto=HTTP/1.1 service=storage size=0 start="11/Nov/2020:10:54:24 +0100" status=500 time_ns=187065 traceid=add5f17e5ec6c6eaa5a523a8752c8c53 uri=/data/accounts/brand-new-user url=/data/accounts/brand-new-user
2020-11-11T10:54:24+01:00 DBG request contents written to file: /var/tmp/ocis-settings/assignments/20b64a18-290a-4f0f-b35b-3bfb55a9c414.json service=ocis

there was a refactoring in reva regarding uploads: cs3org/reva#1285

...

after creating the user he does not show up in the list of users:

curl 'https://localhost:9200/ocs/v2.php/cloud/users' -k -u admin:admin | xmllint -format -
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   333  100   333    0     0   3619      0 --:--:-- --:--:-- --:--:--  3619
<?xml version="1.0" encoding="UTF-8"?>
<ocs>
  <meta>
    <status>ok</status>
    <statuscode>200</statuscode>
    <message>OK</message>
  </meta>
  <data>
    <users>
      <element>einstein</element>
      <element>marie</element>
      <element>richard</element>
      <element>moss</element>
      <element>admin</element>
      <element>konnectd</element>
      <element>reva</element>
    </users>
  </data>
</ocs>

and I can create the user again and again ...

curl -X POST 'https://localhost:9200/ocs/v2.php/cloud/users' -k -u admin:admin -d userid="brand-new-user" -d password="123" -d email="brand-new-user@example.org" | xmllint -format -                        
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   438  100   371  100    67   2810    507 --:--:-- --:--:-- --:--:--  3318
<?xml version="1.0" encoding="UTF-8"?>
<ocs>
  <meta>
    <status>ok</status>
    <statuscode>200</statuscode>
    <message>OK</message>
  </meta>
  <data>
    <enabled>true</enabled>
    <id>brand-new-user</id>
    <display-name>brand-new-user</display-name>
    <displayname>brand-new-user</displayname>
    <email>brand-new-user@example.org</email>
    <uidnumber>20005</uidnumber>
    <gidnumber>30000</gidnumber>
  </data>
</ocs>

@butonic
Copy link
Member Author

butonic commented Nov 11, 2020

@ishank011 @phil-davis cs3org/reva#1285 brakes the file upload for ocis and owncloud storages... I don't know why the reva tests did not pick that up ... I assume because in reva we are not using the ocs api to provision accounts ... this is bad ... 😞

The testsuite does not use TUS to upload files ... do we have tests that cover TUS?

One thing that is definitely a problem is that an error in the storage driver is swallowed and we get a 200 error ...

@ishank011
Copy link
Contributor

@butonic Yes, I figured this after reading your comments on using the dataprovider service to store accounts metadata.

This PR made the non-TUS upload code work with the logic in InitiateFileUpload, where we assume a UUID in the URL instead of the actual path, so the uploads will fail if a request is sent directly to /data/path/to/file instead of calling InitiateFileUpload first and using that URL. I'll push a fix for this.

This is why the reva tests pass, as ocdav handles the InitiateFileUpload part as well.

@butonic
Copy link
Member Author

butonic commented Nov 11, 2020

@ishank011 AFAICT most of the changes in the ocis drilvers Upload() need to be reverted. If you want to stay efficient you might be able to create the uploadInfo yourself and not call NewUpload() which would write the .info to disk. All necessary information is should be returned by GetChunkBLOBInfo().

@butonic butonic force-pushed the update-reva-to-v1.3.1-0.20201109104617-f47d01b73dec branch from f2aa42d to be41c00 Compare November 11, 2020 13:03
@butonic
Copy link
Member Author

butonic commented Nov 11, 2020

the uploed is fixed. next problem I see is:

Sharing::isUserOrGroupInSharedData Received empty response where XML was expected (Exception) | 278s
829

it happens when fetching the list of shares for a file returns this:

curl 'https://localhost:9200/ocs/v2.php/apps/files_sharing/api/v1/shares?path=testfile0.txt' -u marie:radioactivity -k             
<?xml version="1.0" encoding="UTF-8"?>
<ocs><meta><status>error</status><statuscode>998</statuscode><message>not found</message></meta></ocs><?xml version="1.0" encoding="UTF-8"?>
<ocs><meta><status>error</status><statuscode>996</statuscode><message>fixme</message></meta></ocs>

which happens when you create a new user using the ocs provisioning api, upload a file, share it and finally do the above curl request.

the ocis logs contain

2020-11-11T17:03:08+01:00 INF unary code=OK end="11/Nov/2020:17:03:08 +0100" from=tcp://127.0.0.1:56408 pkg=rgrpc service=storage start="11/Nov/2020:17:03:08 +0100" time_ns=1157731 traceid=561259fda178e337375e2e7714a400ed uri=/cs3.gateway.v1beta1.GatewayAPI/CreateHome user-agent=grpc-go/1.26.0
2020-11-11T17:03:08+01:00 DBG director found path=/ocs/v2.php/apps/files_sharing/api/v1/shares policy=reva prefix=/ocs/ routeType=prefix service=proxy
2020-11-11T17:03:08+01:00 DBG access token is already provided pkg=rhttp service=storage traceid=bc9649a5960fd5593b4f2edc0fee2585
2020-11-11T17:03:08+01:00 DBG http routing: head=ocs tail=/v2.php/apps/files_sharing/api/v1/shares svc=ocs pkg=rhttp service=storage
2020-11-11T17:03:08+01:00 DBG ocs routing head=v2.php pkg=rhttp service=storage tail=/apps/files_sharing/api/v1/shares traceid=bc9649a5960fd5593b4f2edc0fee2585
2020-11-11T17:03:08+01:00 DBG http routing head=shares pkg=rhttp service=storage tail=/ traceid=bc9649a5960fd5593b4f2edc0fee2585
2020-11-11T17:03:08+01:00 DBG http routing head= pkg=rhttp service=storage tail=/ traceid=bc9649a5960fd5593b4f2edc0fee2585
2020-11-11T17:03:08+01:00 DBG skipping auth method=/cs3.gateway.v1beta1.GatewayAPI/GetHome pkg=rgrpc service=storage traceid=bc9649a5960fd5593b4f2edc0fee2585
2020-11-11T17:03:08+01:00 INF unary code=OK end="11/Nov/2020:17:03:08 +0100" from=tcp://[::1]:48808 pkg=rgrpc service=storage start="11/Nov/2020:17:03:08 +0100" time_ns=100939 traceid=bc9649a5960fd5593b4f2edc0fee2585 uri=/cs3.gateway.v1beta1.GatewayAPI/GetHome user-agent=grpc-go/1.26.0
2020-11-11T17:03:08+01:00 DBG skipping auth method=/cs3.gateway.v1beta1.GatewayAPI/Stat pkg=rgrpc service=storage traceid=bc9649a5960fd5593b4f2edc0fee2585
2020-11-11T17:03:08+01:00 DBG gateway: split: parts[1]:testfile0.txt != shareFolder:Shares pkg=rgrpc service=storage traceid=bc9649a5960fd5593b4f2edc0fee2585
2020-11-11T17:03:08+01:00 INF unary code=OK end="11/Nov/2020:17:03:08 +0100" from=tcp://[::1]:48802 pkg=rgrpc service=storage start="11/Nov/2020:17:03:08 +0100" time_ns=93319 traceid=bc9649a5960fd5593b4f2edc0fee2585 uri=/cs3.storage.registry.v1beta1.RegistryAPI/GetStorageProvider user-agent=grpc-go/1.26.0
2020-11-11T17:03:08+01:00 DBG NodeFromPath() fn=/testfile0.txt pkg=rgrpc service=storage traceid=bc9649a5960fd5593b4f2edc0fee2585
2020-11-11T17:03:08+01:00 DBG NodeFromPath() walk node={"Exists":false,"ID":"","Name":"testfile0.txt","ParentID":"3d150514-0624-451c-96bf-885942ebbeac"} pkg=rgrpc service=storage traceid=bc9649a5960fd5593b4f2edc0fee2585
2020-11-11T17:03:08+01:00 WRN home/jfd/go/pkg/mod/github.com/cs3org/reva@v1.3.1-0.20201111121955-3fdad19e1215/internal/grpc/services/storageprovider/storageprovider.go:519 > path not found when stating pkg=rgrpc service=storage traceid=bc9649a5960fd5593b4f2edc0fee2585
2020-11-11T17:03:08+01:00 INF unary code=OK end="11/Nov/2020:17:03:08 +0100" from=tcp://[::1]:57374 pkg=rgrpc service=storage start="11/Nov/2020:17:03:08 +0100" time_ns=392947 traceid=bc9649a5960fd5593b4f2edc0fee2585 uri=/cs3.storage.provider.v1beta1.ProviderAPI/Stat user-agent=grpc-go/1.26.0
2020-11-11T17:03:08+01:00 INF unary code=OK end="11/Nov/2020:17:03:08 +0100" from=tcp://[::1]:48808 pkg=rgrpc service=storage start="11/Nov/2020:17:03:08 +0100" time_ns=1624705 traceid=bc9649a5960fd5593b4f2edc0fee2585 uri=/cs3.gateway.v1beta1.GatewayAPI/Stat user-agent=grpc-go/1.26.0
2020-11-11T17:03:08+01:00 ERR fixme error=fixme pkg=rhttp service=storage traceid=bc9649a5960fd5593b4f2edc0fee2585
2020-11-11 17:03:08.896552 I | http: superfluous response.WriteHeader call from go.opencensus.io/plugin/ochttp.(*trackingResponseWriter).WriteHeader (server.go:221)
2020-11-11T17:03:08+01:00 ERR http end="11/Nov/2020:17:03:08 +0100" host=::1 method=GET pkg=rhttp proto=HTTP/1.1 service=storage size=278 start="11/Nov/2020:17:03:08 +0100" status=500 time_ns=2622923 traceid=bc9649a5960fd5593b4f2edc0fee2585 uri=/ocs/v2.php/apps/files_sharing/api/v1/shares?path=testfile0.txt url=/ocs/v2.php/apps/files_sharing/api/v1/shares?path=testfile0.txt

I remember the fixme messages in the code

https://github.com/cs3org/reva/blob/3fdad19e12152d7853f73e42d2b778db746b9ab0/internal/http/services/owncloud/ocs/handlers/apps/sharing/shares/shares.go#L923-L930

I'll need to debug into this ... tomorrow ...

@butonic
Copy link
Member Author

butonic commented Nov 12, 2020

Fixed listing shares for nonexisting path with cs3org/reva#1316

next up: fix nil pointer

2020-11-12 11:40:36.398788 I \| http: panic serving 127.0.0.1:46666: runtime error: invalid memory address or nil pointer dereference | 461s
-- | --
56614 | goroutine 2603 [running]: | 461s
56615 | net/http.(*conn).serve.func1(0xc0017de0a0) | 461s
56616 | /usr/local/go/src/net/http/server.go:1772 +0x139 | 461s
56617 | panic(0x32fb540, 0x52c9f90) | 461s
56618 | /usr/local/go/src/runtime/panic.go:975 +0x3e3 | 461s
56619 | github.com/cs3org/reva/internal/http/services/owncloud/ocs/handlers/apps/sharing/shares.(*Handler).listUserShares(0xc0014c5740, 0xc001c07500, 0x563a228, 0x0, 0x0, 0x52c9ea0, 0x563a228, 0x3710580, 0xc001ba5500, 0xc001a38990, ...) | 461s
56620 | /srv/app/pkg/mod/github.com/cs3org/reva@v1.3.1-0.20201112111535-57eb34544a32/internal/http/services/owncloud/ocs/handlers/apps/sharing/shares/user.go:89 +0xa0c | 461s
56621 | github.com/cs3org/reva/internal/http/services/owncloud/ocs/handlers/apps/sharing/shares.(*Handler).listSharesWithOthers(0xc0014c5740, 0x7f88ebfeec00, 0xc002171860, 0xc001c07500) | 461s
56622 | /srv/app/pkg/mod/github.com/cs3org/reva@v1.3.1-0.20201112111535-57eb34544a32/internal/http/services/owncloud/ocs/handlers/apps/sharing/shares/shares.go:864 +0xde | 461s
56623 | github.com/cs3org/reva/internal/http/services/owncloud/ocs/handlers/apps/sharing/shares.(*Handler).ServeHTTP(0xc0014c5740, 0x7f88ebfeec00, 0xc002171860, 0xc001c07500) | 461s
56624 | /srv/app/pkg/mod/github.com/cs3org/reva@v1.3.1-0.20201112111535-57eb34544a32/internal/http/services/owncloud/ocs/handlers/apps/sharing/shares/shares.go:84 +0x2dd | 461s
56625 | github.com/cs3org/reva/internal/http/services/owncloud/ocs/handlers/apps/sharing.(*Handler).ServeHTTP(0xc001b3a000, 0x7f88ebfeec00, 0xc002171860, 0xc001c07500) | 461s
56626 | /srv/app/pkg/mod/github.com/cs3org/reva@v1.3.1-0.20201112111535-57eb34544a32/internal/http/services/owncloud/ocs/handlers/apps/sharing/sharing.go:62 +0x236 | 461s
56627 | github.com/cs3org/reva/internal/http/services/owncloud/ocs/handlers/apps.(*Handler).ServeHTTP(0xc001b38190, 0x7f88ebfeec00, 0xc002171860, 0xc001c07500) | 461s
56628 | /srv/app/pkg/mod/github.com/cs3org/reva@v1.3.1-0.20201112111535-57eb34544a32/internal/http/services/owncloud/ocs/handlers/apps/apps.go:54 +0x3c8 | 461s
56629 | github.com/cs3org/reva/internal/http/services/owncloud/ocs.(*V1Handler).Handler.func1(0x7f88ebfeec00, 0xc002171860, 0xc001c07500) | 461s
56630 | /srv/app/pkg/mod/github.com/cs3org/reva@v1.3.1-0.20201112111535-57eb34544a32/internal/http/services/owncloud/ocs/v1.go:58 +0x107

@butonic
Copy link
Member Author

butonic commented Nov 12, 2020

fix for nil pointer in cs3org/reva#1317

@butonic butonic force-pushed the update-reva-to-v1.3.1-0.20201109104617-f47d01b73dec branch 5 times, most recently from e34380c to bb7fecc Compare November 12, 2020 22:00
@butonic butonic changed the title Update reva to v1.3.1-0.20201109104617-f47d01b73 Update reva to v1.3.1-0.20201112131316-1c425035c8a2 Nov 12, 2020
@butonic
Copy link
Member Author

butonic commented Nov 12, 2020

hm, running the locally only one test fails

make test-acceptance-api TEST_SERVER_URL=https://localhost:9200 TEST_OCIS=true SKELETON_DIR=../testrunner/apps/testing/data/apiSkeleton DELETE_USER_DATA_CMD='rm -rf /var/tmp/ocis/storage/users/nodes/root/* /var/tmp/ocis/storage/users/nodes/*-*-*-*' BEHAT_FILTER_TAGS='~@skipOnOcis-OCIS-Storage' OCIS_SKELETON_STRATEGY=upload PATH_TO_CORE=/var/www/html/testrunner

[...]

--- Failed scenarios:

    /var/www/html/ocis/tests/acceptance/features/apiOcisSpecific/apiVersions-fileVersions.feature:21

95 scenarios (94 passed, 1 failed)
637 steps (635 passed, 1 failed, 1 skipped)
9m42.58s (16.91Mb)
runsh: Total 95 scenarios (94 passed, 1 failed)
runsh: Exit code of main run: 1
runsh: Total unexpected failed scenarios throughout the test run:
apiOcisSpecific/apiVersions-fileVersions.feature:21
runsh: There were no unexpected success.
make: *** [Makefile:155: test-acceptance-api] Error 1

in the localApiTests-ocis-storage logs on drone I found this:

2020-11-12T22:19:06Z ERR error sending a grpc create share request error="rpc error: code = Unknown desc = gateway: error calling CreateShare: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp 127.0.0.1:9150: connect: connection refused\"" pkg=rhttp service=storage traceid=a76fd2aa630f5e54f937fad04bfe498b

95 times

and it is always port 9150, which is the reva share service. I have to assume it died ...

but how ...

@ishank011
Copy link
Contributor

@butonic I still see a lot of GET requests to dataprovider for various accounts return a 404. Are the uploads actually succeeding or is this due to some other issue?

42895 | 2020-11-12T23:15:03Z INF dataprovider routing: path=/index.cs3/unique.github.com.owncloud.ocis.accounts.pkg.proto.v0.Account.PreferredName/alice pkg=rhttp service=storage traceid=9a3ec7b4856621e72da31fc017dbc154 | 541s
42896 | 2020-11-12T23:15:03Z ERR datasvc: file not found error="error: not found: 248e751e-eb42-4aed-96bc-18fd9043e9de/alice" pkg=rhttp service=storage traceid=9a3ec7b4856621e72da31fc017dbc154 | 541s
42897 | 2020-11-12T23:15:03Z WRN http end="12/Nov/2020:23:15:03 +0000" host=127.0.0.1 method=GET pkg=rhttp proto=HTTP/1.1 service=storage size=0 start="12/Nov/2020:23:15:03 +0000" status=404 time_ns=332800 traceid=9a3ec7b4856621e72da31fc017dbc154 uri=/data/index.cs3/unique.github.com.owncloud.ocis.accounts.pkg.proto.v0.Account.PreferredName/alice url=/data/index.cs3/unique.github.com.owncloud.ocis.accounts.pkg.proto.v0.Account.PreferredName/alice | 541s
42898 | 2020-11-12T23:15:03Z INF dataprovider routing: path=/index.cs3/unique.github.com.owncloud.ocis.accounts.pkg.proto.v0.Account.OnPremisesSamAccountName/alice pkg=rhttp service=storage traceid=4a7c1c303091a68a3cf4a09f52026465 | 541s
42899 | 2020-11-12T23:15:03Z ERR datasvc: file not found error="error: not found: 554201a1-e8ec-4c3c-b8ef-19c18e3c33ae/alice" pkg=rhttp service=storage traceid=4a7c1c303091a68a3cf4a09f52026465 | 541s
42900 | 2020-11-12T23:15:03Z WRN http end="12/Nov/2020:23:15:03 +0000" host=127.0.0.1 method=GET pkg=rhttp proto=HTTP/1.1 service=storage size=0 start="12/Nov/2020:23:15:03 +0000" status=404 time_ns=239616 traceid=4a7c1c303091a68a3cf4a09f52026465 uri=/data/index.cs3/unique.github.com.owncloud.ocis.accounts.pkg.proto.v0.Account.OnPremisesSamAccountName/alice url=/data/index.cs3/unique.github.com.owncloud.ocis.accounts.pkg.proto.v0.Account.OnPremisesSamAccountName/alice | 541s
42901 | 2020-11-12T23:15:03Z INF dataprovider routing: path=/index.cs3/unique.github.com.owncloud.ocis.accounts.pkg.proto.v0.Account.Mail/alice@example.org pkg=rhttp service=storage traceid=4be5a874f2b993a459c0f39d2dc005b4 | 541s
42902 | 2020-11-12T23:15:03Z ERR datasvc: file not found error="error: not found: 7d446f92-9511-49e7-be8b-a84aa90d2ff1/alice@example.org" pkg=rhttp service=storage traceid=4be5a874f2b993a459c0f39d2dc005b4 | 541s
42903 | 2020-11-12T23:15:03Z WRN http end="12/Nov/2020:23:15:03 +0000" host=127.0.0.1 method=GET pkg=rhttp proto=HTTP/1.1 service=storage size=0 start="12/Nov/2020:23:15:03 +0000" status=404 time_ns=542150 traceid=4be5a874f2b993a459c0f39d2dc005b4 uri=/data/index.cs3/unique.github.com.owncloud.ocis.accounts.pkg.proto.v0.Account.Mail/alice@example.org url=/data/index.cs3/unique.github.com.owncloud.ocis.accounts.pkg.proto.v0.Account.Mail/alice@example.org | 541s
42904 | 2020-11-12T23:15:03Z INF dataprovider routing: path=/accounts/Alice pkg=rhttp service=storage traceid=fd40f5a41f54d99d4b390224741c2427 | 541s
42905 | 2020-11-12T23:15:03Z ERR datasvc: file not found error="error: not found: 6ae2d8f9-4bc2-4ebc-86e5-66bbb578e0aa/Alice" pkg=rhttp service=storage traceid=fd40f5a41f54d99d4b390224741c2427

@butonic
Copy link
Member Author

butonic commented Nov 13, 2020

@ishank011 the 404 be expected, because the testsuite is creating and deleting users for every test step and sometimes double checks that a user exists/was deleted. so I'm not tooo concerned. But will look into that as well.

@butonic
Copy link
Member Author

butonic commented Nov 13, 2020

dumping the error so it does not get lost:


1.14: Pulling from webhippie/golang | 0s
-- | --
2 | Digest: sha256:9993363d7780c3fb8392e9f05f1bcf6bbae8f5b2b822938ecaad384f3288e8dd | 0s
3 | Status: Image is up to date for webhippie/golang:1.14 | 0s
4 | + apk add mailcap | 2s
5 | fetch http://dl-cdn.alpinelinux.org/alpine/edge/main/x86_64/APKINDEX.tar.gz | 2s
6 | fetch http://dl-cdn.alpinelinux.org/alpine/edge/community/x86_64/APKINDEX.tar.gz | 2s
7 | fetch http://dl-cdn.alpinelinux.org/alpine/edge/testing/x86_64/APKINDEX.tar.gz | 3s
8 | (1/1) Installing mailcap (2.1.49-r0) | 3s
9 | OK: 306 MiB in 77 packages | 3s
10 | + mkdir -p /srv/app/tmp/ocis/owncloud/data/ | 3s
11 | + mkdir -p /srv/app/tmp/ocis/storage/users/ | 3s
12 | + ocis/bin/ocis server | 3s
13 | 2020-11-13T12:36:31Z INF no config found on preconfigured location service=ocis | 3s
14 | 2020-11-13 12:36:31.566929 I \| oCIS binary not present on `$PATH` | 3s
15 | db file doesn't exist, creating one with contents: `{}` | 3s
16 | runtime ready on `localhost:10666` | 3s
17 | runtime not available, retrying in 1 second... | 3s
18 | watching api | 4s
19 | watching web | 4s
20 | watching registry | 4s
21 | watching proxy | 4s
22 | watching store | 4s
23 | watching settings | 4s
24 | watching phoenix | 4s
25 | watching graph | 4s
26 | watching graph-explorer | 4s
27 | watching ocs | 4s
28 | watching webdav | 4s
29 | watching storage-frontend | 4s
30 | watching storage-gateway | 4s
31 | watching storage-userprovider | 4s
32 | watching storage-auth-basic | 4s
33 | watching storage-auth-bearer | 4s
34 | watching storage-home | 4s
35 | watching storage-users | 4s
36 | watching storage-metadata | 4s
37 | watching storage-public-link | 4s
38 | watching glauth | 4s
39 | watching konnectd | 4s
40 | watching thumbnails | 4s
41 | 2020-11-13T12:36:32Z INF no config found on preconfigured location service=ocis | 4s
42 | 2020-11-13T12:36:32Z INF no config found on preconfigured location service=ocis | 4s
43 | 2020-11-13T12:36:32Z INF no config found on preconfigured location service=store | 4s
44 | 2020-11-13T12:36:32Z INF no config found on preconfigured location service=phoenix | 4s
45 | 2020-11-13T12:36:32Z INF starting server addr= service=store transport=grpc | 4s
46 | 2020-11-13T12:36:32Z INF starting server addr=0.0.0.0:9100 service=phoenix transport=http | 4s
47 | 2020-11-13T12:36:32Z INF starting server addr=0.0.0.0:9104 service=phoenix transport=debug | 4s
48 | 2020-11-13 12:36:32  file=web/service.go:258 level=info Listening on [::]:9100 | 4s
49 | 2020-11-13T12:36:32Z INF no config found on preconfigured location service=ocis | 4s
50 | 2020-11-13 12:36:32  file=http/http.go:90 level=info service=web HTTP API Listening on [::]:8082 | 4s
51 | 2020-11-13 12:36:32  file=v2@v2.9.1/service.go:200 level=info service=web Starting [service] com.owncloud.web | 4s
52 | 2020-11-13 12:36:32  file=grpc/grpc.go:864 level=info service=web Server [grpc] Listening on [::]:33519 | 4s
53 | 2020-11-13 12:36:32  file=grpc/grpc.go:697 level=info service=web Registry [mdns] Registering node: com.owncloud.web-3b9b3587-9a75-4b16-a3e2-cebfe1d1f6ac | 4s
54 | 2020-11-13T12:36:32Z INF starting server addr=0.0.0.0:9460 service=store transport=debug | 5s
55 | 2020-11-13T12:36:32Z INF no config found on preconfigured location service=ocis | 5s
56 | 2020-11-13T12:36:32Z INF Policies service=proxy source=runtime | 5s
57 | 2020-11-13T12:36:32Z WRN policy-selector not configured. Will always use first policy: 'reva' service=proxy | 5s
58 | 2020-11-13T12:36:32Z INF loading OIDC middleware service=proxy | 5s
59 | 2020-11-13T12:36:32Z WRN No tls certificate provided, using a generated one service=proxy | 5s
60 | 2020-11-13 12:36:32  file=v2@v2.9.1/service.go:200 level=info Starting [service] com.owncloud.api.store | 5s
61 | 2020-11-13 12:36:32  file=grpc/grpc.go:864 level=info Server [grpc] Listening on [::]:40581 | 5s
62 | 2020-11-13 12:36:32  file=grpc/grpc.go:697 level=info Registry [mdns] Registering node: com.owncloud.api.store-71c16d32-d06e-43c9-8c80-0148340a2200 | 5s
63 | 2020-11-13T12:36:32Z INF no config found on preconfigured location service=ocis | 5s
64 | 2020-11-13T12:36:32Z INF no config found on preconfigured location service=settings | 5s
65 | 2020-11-13T12:36:32Z INF starting server addr=0.0.0.0:9190 service=settings transport=http | 5s
66 | 2020-11-13T12:36:32Z INF creating container on /var/tmp/ocis-settings service=ocis | 5s
67 | 2020-11-13T12:36:32Z INF starting server addr=0.0.0.0:9191 service=settings transport=grpc | 5s
68 | 2020-11-13T12:36:32Z INF starting server addr=0.0.0.0:9194 service=settings transport=debug | 5s
69 | 2020-11-13 12:36:32  file=v2@v2.9.1/service.go:200 level=info Starting [service] com.owncloud.api.settings | 5s
70 | 2020-11-13 12:36:32  file=grpc/grpc.go:864 level=info Server [grpc] Listening on [::]:9191 | 5s
71 | 2020-11-13 12:36:32  file=web/service.go:258 level=info Listening on [::]:9190 | 5s
72 | 2020-11-13 12:36:32  file=grpc/grpc.go:697 level=info Registry [mdns] Registering node: com.owncloud.api.settings-36ac1da5-9018-4e68-af81-25dbd21bc70a | 5s
73 | 2020-11-13T12:36:32Z INF no config found on preconfigured location service=ocis | 5s
74 | 2020-11-13 12:36:32  file=v2@v2.9.1/service.go:200 level=info service=registry Starting [service] com.owncloud.registry | 5s
75 | 2020-11-13 12:36:32  file=grpc/grpc.go:864 level=info service=registry Server [grpc] Listening on [::]:8000 | 5s
76 | 2020-11-13 12:36:32  file=grpc/grpc.go:697 level=info service=registry Registry [mdns] Registering node: com.owncloud.registry-1977a917-8f3a-450b-92a7-50db60cc6cd8 | 5s
77 | 2020-11-13T12:36:32Z INF no config found on preconfigured location service=ocis | 5s
78 | 2020-11-13T12:36:32Z INF starting server addr=0.0.0.0:9143 service=storage transport=debug | 5s
79 | 2020-11-13T12:36:32Z INF registering external service com.owncloud.storage-ce246db4-f6aa-43db-be4c-abf2b456498c@0.0.0.0:9142 service=storage | 5s
80 | 2020-11-13T12:36:32Z INF host info: 6b23ca1ac89e service=storage | 5s
81 | 2020-11-13T12:36:32Z INF running on 16 cpus service=storage | 5s
82 | 2020-11-13T12:36:32Z INF pidfile saved at: /tmp/revad-storage-gateway-ce246db4-f6aa-43db-be4c-abf2b456498c.pid pkg=grace service=storage | 5s
83 | 2020-11-13T12:36:32Z INF rgrpc: grpc service enabled: gateway pkg=rgrpc service=storage | 5s
84 | 2020-11-13T12:36:32Z INF rgrpc: grpc service enabled: authregistry pkg=rgrpc service=storage | 5s
85 | 2020-11-13T12:36:32Z INF rgrpc: grpc service enabled: storageregistry pkg=rgrpc service=storage | 5s
86 | 2020-11-13T12:36:32Z INF grpc server listening at tcp:0.0.0.0:9142 pkg=rgrpc service=storage | 5s
87 | 2020-11-13T12:36:32Z INF no config found on preconfigured location service=ocis | 5s
88 | 2020-11-13T12:36:32Z INF no config found on preconfigured location service=ocis | 5s
89 | process [graph-explorer] exited with code: 0 | 5s
90 | 2020-11-13 12:36:32  file=api/api.go:285 level=info service=api Registering API Default Handler at / | 5s
91 | 2020-11-13 12:36:33  file=http/http.go:90 level=info service=api HTTP API Listening on [::]:8080 | 5s
92 | 2020-11-13 12:36:33  file=v2@v2.9.1/service.go:200 level=info service=api Starting [service] com.owncloud.api | 5s
93 | 2020-11-13 12:36:33  file=grpc/grpc.go:864 level=info service=api Server [grpc] Listening on [::]:34865 | 5s
94 | 2020-11-13 12:36:33  file=grpc/grpc.go:697 level=info service=api Registry [mdns] Registering node: com.owncloud.api-c1c330b8-5c0a-418d-a3c8-7d3b5e2ae4aa | 5s
95 | 2020-11-13T12:36:33Z INF no config found on preconfigured location service=ocis | 5s
96 | 2020-11-13T12:36:33Z INF starting server addr=0.0.0.0:9149 service=storage transport=debug | 5s
97 | 2020-11-13T12:36:33Z INF host info: 6b23ca1ac89e service=storage | 5s
98 | 2020-11-13T12:36:33Z INF no config found on preconfigured location service=ocis | 5s
99 | 2020-11-13T12:36:33Z INF running on 16 cpus service=storage | 5s
100 | 2020-11-13T12:36:33Z INF starting server addr=0.0.0.0:9156 service=storage transport=debug | 5s
101 | 2020-11-13T12:36:33Z INF host info: 6b23ca1ac89e service=storage | 5s
102 | 2020-11-13T12:36:33Z INF running on 16 cpus service=storage | 5s
103 | 2020-11-13T12:36:33Z INF pidfile saved at: /tmp/revad-storage-auth-bearer-0ea7f624-0aac-47c0-9407-67f56822055c.pid pkg=grace service=storage | 5s
104 | 2020-11-13T12:36:33Z INF pidfile saved at: /tmp/revad-storage-home-0f16986c-9a07-40ba-b798-5cef0dd54704.pid pkg=grace service=storage | 5s
105 | 2020-11-13T12:36:33Z INF rgrpc: grpc service enabled: authprovider pkg=rgrpc service=storage | 5s
106 | 2020-11-13T12:36:33Z INF grpc server listening at tcp:0.0.0.0:9148 pkg=rgrpc service=storage | 5s
107 | 2020-11-13T12:36:33Z INF http service enabled: dataprovider@/data pkg=rhttp service=storage | 5s
108 | 2020-11-13T12:36:33Z INF http server listening at http://0.0.0.0:9155 pkg=rhttp service=storage | 5s
109 | 2020-11-13T12:36:33Z INF rgrpc: grpc service enabled: storageprovider pkg=rgrpc service=storage | 5s
110 | 2020-11-13T12:36:33Z INF grpc server listening at tcp:0.0.0.0:9154 pkg=rgrpc service=storage | 5s
111 | 2020-11-13T12:36:33Z INF no config found on preconfigured location service=ocis | 5s
112 | 2020-11-13T12:36:33Z INF no config found on preconfigured location service=ocs | 5s
113 | 2020-11-13T12:36:33Z INF starting server addr=0.0.0.0:9110 service=ocs transport=http | 5s
114 | 2020-11-13T12:36:33Z INF no config found on preconfigured location service=ocis | 5s
115 | 2020-11-13T12:36:33Z INF starting server addr=0.0.0.0:9114 service=ocs transport=debug | 5s
116 | 2020-11-13T12:36:33Z INF starting server addr=0.0.0.0:9159 service=storage transport=debug | 5s
117 | 2020-11-13 12:36:33  file=web/service.go:258 level=info Listening on [::]:9110 | 5s
118 | 2020-11-13T12:36:33Z INF host info: 6b23ca1ac89e service=storage | 5s
119 | 2020-11-13T12:36:33Z INF running on 16 cpus service=storage | 5s
120 | 2020-11-13T12:36:33Z INF pidfile saved at: /tmp/revad-storage-users-543b2ef5-c796-4735-87b1-0fe58ca05035.pid pkg=grace service=storage | 5s
121 | 2020-11-13T12:36:33Z INF http service enabled: dataprovider@/data pkg=rhttp service=storage | 5s
122 | 2020-11-13T12:36:33Z INF no config found on preconfigured location service=ocis | 5s
123 | 2020-11-13T12:36:33Z INF http server listening at http://0.0.0.0:9158 pkg=rhttp service=storage | 5s
124 | 2020-11-13T12:36:33Z INF rgrpc: grpc service enabled: storageprovider pkg=rgrpc service=storage | 5s
125 | 2020-11-13T12:36:33Z INF grpc server listening at tcp:0.0.0.0:9157 pkg=rgrpc service=storage | 5s
126 | 2020-11-13T12:36:33Z INF no config found on preconfigured location service=ocis | 5s
127 | 2020-11-13T12:36:33Z INF no config found on preconfigured location service=webdav | 5s
128 | 2020-11-13T12:36:33Z INF starting server addr=0.0.0.0:9115 service=webdav transport=http | 5s
129 | 2020-11-13T12:36:33Z INF starting server addr=0.0.0.0:9119 service=webdav transport=debug | 5s
130 | 2020-11-13 12:36:33  file=web/service.go:258 level=info Listening on [::]:9115 | 5s
131 | 2020-11-13T12:36:33Z INF starting server addr=0.0.0.0:9141 service=storage transport=debug | 5s
132 | 2020-11-13T12:36:33Z INF host info: 6b23ca1ac89e service=storage | 5s
133 | 2020-11-13T12:36:33Z INF running on 16 cpus service=storage | 5s
134 | 2020-11-13T12:36:33Z INF pidfile saved at: /tmp/revad-storage-frontend-b58bfb62-5595-45bf-b94b-daa3e5a94f8c.pid pkg=grace service=storage | 5s
135 | 2020-11-13T12:36:33Z INF no config found on preconfigured location service=ocis | 5s
136 | 2020-11-13T12:36:33Z INF http service enabled: datagateway@/data pkg=rhttp service=storage | 5s
137 | 2020-11-13T12:36:33Z INF http service enabled: ocdav@/ pkg=rhttp service=storage | 5s
138 | 2020-11-13T12:36:33Z INF starting server addr=0.0.0.0:9147 service=storage transport=debug | 5s
139 | 2020-11-13T12:36:33Z INF http service enabled: ocs@/ocs pkg=rhttp service=storage | 5s
140 | 2020-11-13T12:36:33Z INF host info: 6b23ca1ac89e service=storage | 5s
141 | 2020-11-13T12:36:33Z INF http middleware enabled: cors pkg=rhttp service=storage | 5s
142 | 2020-11-13T12:36:33Z INF chaining http middleware cors with priority  200 pkg=rhttp service=storage | 5s
143 | 2020-11-13T12:36:33Z INF unprotected URL: /status.php pkg=rhttp service=storage | 5s
144 | 2020-11-13T12:36:33Z INF running on 16 cpus service=storage | 5s
145 | 2020-11-13T12:36:33Z INF unprotected URL: /remote.php/dav/public-files pkg=rhttp service=storage | 5s
146 | 2020-11-13T12:36:33Z INF http server listening at http://0.0.0.0:9140 pkg=rhttp service=storage | 5s
147 | 2020-11-13T12:36:33Z INF pidfile saved at: /tmp/revad-storage-auth-basic-fc3c250d-22b9-4c33-826b-20a8606ec006.pid pkg=grace service=storage | 5s
148 | 2020-11-13T12:36:33Z INF rgrpc: grpc service enabled: authprovider pkg=rgrpc service=storage | 5s
149 | 2020-11-13T12:36:33Z INF grpc server listening at tcp:0.0.0.0:9146 pkg=rgrpc service=storage | 5s
150 | 2020-11-13T12:36:33Z INF no config found on preconfigured location service=ocis | 5s
151 | 2020-11-13T12:36:33Z INF no config found on preconfigured location service=ocis | 5s
152 | 2020-11-13T12:36:33Z INF starting server addr=0.0.0.0:9217 service=storage transport=debug | 5s
153 | 2020-11-13T12:36:33Z INF host info: 6b23ca1ac89e service=storage | 5s
154 | 2020-11-13T12:36:33Z INF running on 16 cpus service=storage | 5s
155 | 2020-11-13T12:36:33Z INF no config found on preconfigured location service=ocis | 5s
156 | 2020-11-13T12:36:33Z INF pidfile saved at: /tmp/revad-storage-metadata-0ab21ec4-277b-4583-bac4-c412ee26733a.pid pkg=grace service=storage | 5s
157 | 2020-11-13T12:36:33Z INF rgrpc: grpc service enabled: storageprovider pkg=rgrpc service=storage | 5s
158 | 2020-11-13T12:36:33Z INF http service enabled: dataprovider@/data pkg=rhttp service=storage | 5s
159 | 2020-11-13T12:36:33Z INF http server listening at http://0.0.0.0:9216 pkg=rhttp service=storage | 5s
160 | 2020-11-13T12:36:33Z INF grpc server listening at tcp:0.0.0.0:9215 pkg=rgrpc service=storage | 5s
161 | 2020-11-13T12:36:33Z INF no config found on preconfigured location service=ocis | 5s
162 | process [graph] exited with code: 0 | 5s
163 | 2020-11-13T12:36:33Z INF starting server addr=0.0.0.0:9145 service=storage transport=debug | 5s
164 | 2020-11-13T12:36:33Z INF host info: 6b23ca1ac89e service=storage | 5s
165 | 2020-11-13T12:36:33Z INF running on 16 cpus service=storage | 5s
166 | 2020-11-13T12:36:33Z INF pidfile saved at: /tmp/revad-storage-userprovider-c7743eed-30d5-49e7-baca-e1b393faa157.pid pkg=grace service=storage | 5s
167 | 2020-11-13T12:36:33Z INF rgrpc: grpc service enabled: userprovider pkg=rgrpc service=storage | 5s
168 | 2020-11-13T12:36:33Z INF grpc server listening at tcp:0.0.0.0:9144 pkg=rgrpc service=storage | 5s
169 | 2020-11-13T12:36:33Z INF no config found on preconfigured location service=ocis | 5s
170 | 2020-11-13T12:36:33Z INF starting server addr=0.0.0.0:9179 service=storage transport=debug | 5s
171 | 2020-11-13T12:36:33Z INF host info: 6b23ca1ac89e service=storage | 5s
172 | 2020-11-13T12:36:33Z INF running on 16 cpus service=storage | 5s
173 | 2020-11-13T12:36:33Z INF pidfile saved at: /tmp/revad-storage-public-link-b6e1178c-6394-4780-b419-c0c3977006ad.pid pkg=grace service=storage | 5s
174 | 2020-11-13T12:36:33Z INF rgrpc: grpc service enabled: authprovider pkg=rgrpc service=storage | 5s
175 | 2020-11-13T12:36:33Z INF rgrpc: grpc service enabled: publicstorageprovider pkg=rgrpc service=storage | 5s
176 | 2020-11-13T12:36:33Z INF grpc server listening at tcp:0.0.0.0:9178 pkg=rgrpc service=storage | 5s
177 | 2020-11-13T12:36:33Z INF no config found on preconfigured location service=ocis | 5s
178 | 2020-11-13T12:36:33Z INF no config found on preconfigured location service=thumbnails | 5s
179 | 2020-11-13T12:36:33Z INF starting server addr=0.0.0.0:9185 service=thumbnails transport=grpc | 5s
180 | 2020-11-13T12:36:33Z INF starting server addr=0.0.0.0:9189 service=thumbnails transport=debug | 5s
181 | 2020-11-13 12:36:33  file=v2@v2.9.1/service.go:200 level=info Starting [service] com.owncloud.api.thumbnails | 5s
182 | 2020-11-13 12:36:33  file=grpc/grpc.go:864 level=info Server [grpc] Listening on [::]:9185 | 5s
183 | 2020-11-13 12:36:33  file=grpc/grpc.go:697 level=info Registry [mdns] Registering node: com.owncloud.api.thumbnails-84dd10cf-8600-44af-b1f0-11b16baa98de | 5s
184 | 2020-11-13T12:36:33Z INF no config found on preconfigured location service=ocis | 5s
185 | 2020-11-13T12:36:33Z INF no config found on preconfigured location service=konnectd | 5s
186 | 2020-11-13T12:36:33Z INF starting server addr=0.0.0.0:9130 service=konnectd transport=http | 5s
187 | 2020-11-13T12:36:33Z WRN missing --encryption-secret parameter, using random encyption secret with 32 bytes service=konnectd | 5s
188 | 2020-11-13T12:36:33Z WRN missing --signing-private-key parameter, using random 2048 bit signing key alg=PS256 service=konnectd | 5s
189 | 2020-11-13T12:36:33Z INF Written server.crt service=proxy | 5s
190 | 2020-11-13T12:36:33Z INF Written server.key service=proxy | 5s
191 | 2020-11-13T12:36:33Z INF starting server addr=0.0.0.0:9200 service=proxy transport=https | 5s
192 | 2020-11-13T12:36:33Z INF starting server addr=0.0.0.0:9205 service=proxy transport=debug | 5s
193 | 2020-11-13 12:36:33  file=web/service.go:258 level=info Listening on [::]:9200 | 5s
194 | 2020-11-13T12:36:33Z INF Written server.crt service=glauth | 5s
195 | 2020-11-13T12:36:33Z INF Written ldap.key service=glauth | 5s
196 | 2020-11-13T12:36:33Z INF Using backend backend={"BaseDN":"dc=example,dc=org","Datastore":"accounts","GroupFormat":"ou","Insecure":false,"NameFormat":"cn","SSHKeyAttr":"sshPublicKey","Servers":["https://demo.owncloud.com/apps/graphapi/v1.0"],"UseGraphAPI":true} name=glauth service=glauth verbosity=3 | 5s
197 | 2020-11-13T12:36:33Z INF starting server addr=0.0.0.0:9129 service=glauth transport=debug | 5s
198 | 2020-11-13T12:36:33Z INF ldaps server listening address=0.0.0.0:9126 name=glauth service=glauth verbosity=3 | 5s
199 | 2020-11-13T12:36:33Z INF ldap server listening address=0.0.0.0:9125 name=glauth service=glauth verbosity=3 | 5s
200 | 2020-11-13T12:36:33Z INF encryption set up with 32 key size service=konnectd | 5s
201 | 2020-11-13T12:36:33Z INF ldap server identifier backend set up ldap="ldap://localhost:9125 " service=konnectd | 5s
202 | 2020-11-13T12:36:33Z INF identifier set up security=A256GCM:A256GCMKW service=konnectd | 5s
203 | 2020-11-13T12:36:33Z INF using identifier backed identity manager service=konnectd | 5s
204 | 2020-11-13T12:36:33Z INF identity manager set up claims=["name","family_name","given_name","email","email_verified"] name=ldap scopes=["offline_access","email","konnect/uuid","konnect/raw_sub","profile"] service=konnectd | 5s
205 | 2020-11-13T12:36:33Z INF set provider signing alg alg=PS256 service=konnectd | 5s
206 | 2020-11-13T12:36:33Z INF set provider signing key id= method=*jwt.SigningMethodRSAPSS service=konnectd type=*rsa.PrivateKey | 5s
207 | 2020-11-13T12:36:33Z INF set provider validation key id= service=konnectd type=*rsa.PublicKey | 5s
208 | 2020-11-13T12:36:33Z INF set provider validation key id=default service=konnectd type=*rsa.PublicKey | 5s
209 | 2020-11-13T12:36:33Z INF set provider validation key id=default service=konnectd type=*rsa.PublicKey | 5s
210 | 2020-11-13T12:36:33Z INF oidc token signing default set up alg=PS256 id= method=*jwt.SigningMethodRSAPSS service=konnectd | 5s
211 | 2020-11-13T12:36:33Z INF starting server addr=0.0.0.0:9134 service=konnectd transport=debug | 5s
212 | 2020-11-13 12:36:33  file=web/service.go:258 level=info Listening on [::]:9130 | 5s
213 | watching accounts | 6s
214 | watching storage-sharing | 6s
215 | 2020-11-13T12:36:34Z INF no config found on preconfigured location service=ocis | 7s
216 | 2020-11-13T12:36:34Z INF starting server addr=0.0.0.0:9151 service=storage transport=debug | 7s
217 | 2020-11-13T12:36:34Z INF host info: 6b23ca1ac89e service=storage | 7s
218 | 2020-11-13T12:36:34Z INF running on 16 cpus service=storage | 7s
219 | 2020-11-13T12:36:34Z INF pidfile saved at: /tmp/revad-storage-sharing-0f15f885-f949-4d92-9a19-d8cc1f4d2846.pid pkg=grace service=storage | 7s
220 | 2020-11-13T12:36:34Z INF rgrpc: grpc service enabled: publicshareprovider pkg=rgrpc service=storage | 7s
221 | 2020-11-13T12:36:34Z ERR error starting the grpc server error="unable to register services: rgrpc: grpc service usershareprovider could not be started,: error loading the file containing the shares: error opening/creating the file: /var/tmp/ocis/shares.json: open /var/tmp/ocis/shares.json: no such file or directory" service=storage | 7s
222 | 2020-11-13T12:36:34Z INF pid file "/tmp/revad-storage-sharing-0f15f885-f949-4d92-9a19-d8cc1f4d2846.pid" got removed pkg=grace service=storage | 7s
223 | 2020-11-13T12:36:34Z INF no config found on preconfigured location service=ocis | 7s
224 | 2020-11-13T12:36:34Z INF no config found on preconfigured location service=accounts | 7s
225 | process [storage-sharing] exited with code: 1


@butonic butonic force-pushed the update-reva-to-v1.3.1-0.20201109104617-f47d01b73dec branch from bb7fecc to 57e29a9 Compare November 13, 2020 13:21
@butonic
Copy link
Member Author

butonic commented Nov 13, 2020

so

221 | 2020-11-13T12:36:34Z ERR error starting the grpc server error="unable to register services: rgrpc: grpc service usershareprovider could not be started,: error loading the file containing the shares: error opening/creating the file: /var/tmp/ocis/shares.json: open /var/tmp/ocis/shares.json: no such file or directory" service=storage | 7s

maybe because the tests when using the ocis driver sometimes wipe /var/tmp/ocis/*?

@butonic
Copy link
Member Author

butonic commented Nov 13, 2020

STORAGE_SHARING_USER_JSON_FILE defaults to /var/tmp/ocis/shares.json. And AFAICT that folder is not created when using the ocis driver because the data paths for ocis are mostly configured to use /srv/app/tmp/ocis/.... So ocis will create /srv/app/tmp/ocis/... but the storage sharing server relies on the path to exist. It does magically create any folder... and dies.

setting STORAGE_SHARING_USER_JSON_FILE to /srv/app/tmp/ocis/shares.json should fix this. Done with 57e29a9

@@ -23,7 +23,7 @@ Feature: dav-versions
And user "Alice" uploads file "filesForUpload/davtest.txt" to filenames based on "/davtest.txt" with all mechanisms using the WebDAV API
Then the version folder of file "/davtest.txt-olddav-regular" for user "Alice" should contain "1" element
And the version folder of file "/davtest.txt-newdav-regular" for user "Alice" should contain "1" element
And as "Alice" file "/davtest.txt-olddav-oldchunking" should not exist
Then the version folder of file "/davtest.txt-olddav-oldchunking" for user "Alice" should contain "0" element
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

https://drone.owncloud.com/owncloud/ocis/1451/14/7
It returned 1 element in CI

Suggested change
Then the version folder of file "/davtest.txt-olddav-oldchunking" for user "Alice" should contain "0" element
Then the version folder of file "/davtest.txt-olddav-oldchunking" for user "Alice" should contain "1" element

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yep, but it flips with the other storage. I think I have that solved in my next commit.

I'm more puzzled by:


ℹ Connected to selenium on port 4444 (500ms).
--
992 | tests/acceptance/features/webUISharingInternalUsers/shareWithUsers.feature:486
993 |  
994 | Given the setting "shareapi_auto_accept_share" of app "core" has been set to "no"
995 | And the administrator has set the default folder for received shares to "Shares"
996 | And these users have been created with default attributes:
997 | │ username │
998 | │ user1    │
999 | │ user2    │
1000 | Given user "user1" has shared folder "simple-folder" with user "user2"
1001 | And user "user2" has accepted the share "simple-folder" offered by user "user1"
1002 | When user "user2" has logged in using the webUI
1003 | √ Element <input[autocomplete="kopano-account username"]> was visible after 597 milliseconds.
1004 | √ Element <#oc-app-container> was visible after 2605 milliseconds.
1005 | √ Element <//button[@id="new-file-menu-btn" and contains(@class, "oc-button-primary") and not(@disabled)]> was present after 1932 milliseconds.
1006 | √ Element <//div[contains(@class, "oc-file") and @data-preview-loaded="false"]> was not present after 1506 milliseconds.
1007 | And the user opens folder "Shares" using the webUI
1008 | √ Element <#files-list-container> was present after 26 milliseconds.
1009 | √ Element <.vue-recycle-scroller> was visible after 46 milliseconds.
1010 | √ Element <.vue-recycle-scroller> was visible after 28 milliseconds.
1011 | √ Element <//span[contains(@class, "oc-file-name") and text()='Shares' and not(../span[contains(@class, "oc-file-extension")])]/ancestor::div[@data-is-visible="true"]//div[contains(@class, "oc-file") and (@data-preview-loaded="true" or @data-preview-loaded="disabled")]> was visible after 46 milliseconds.
1012 | √ Element <#files-list-progress> was not present after 3124 milliseconds.
1013 | √ Element <//div[contains(@class, "oc-file") and @data-preview-loaded="false"]> was not present after 19 milliseconds.
1014 | And the user opens the sharing sidebar for folder "simple-folder"
1015 | √ Element <#files-list-container> was present after 15 milliseconds.
1016 | √ Element <.vue-recycle-scroller> was visible after 41 milliseconds.
1017 | √ Element <.vue-recycle-scroller> was visible after 36 milliseconds.
1018 | √ Element <//span[contains(@class, "oc-file-name") and text()='simple-folder' and not(../span[contains(@class, "oc-file-extension")])]/ancestor::div[@data-is-visible="true"]//div[contains(@class, "oc-file") and (@data-preview-loaded="true" or @data-preview-loaded="disabled")]> was visible after 49 milliseconds.
1019 | (node:391) MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 11 queue:finished listeners added. Use emitter.setMaxListeners() to increase limit
1020 | Then the following resources should have share indicators on the webUI
1021 | │ fileName      │ expectedIndicators │
1022 | │ simple-folder │ user-indirect      │
1023 | √ Element <#files-list-container> was present after 17 milliseconds.
1024 | √ Element <.vue-recycle-scroller> was visible after 38 milliseconds.
1025 | √ Element <.vue-recycle-scroller> was visible after 36 milliseconds.
1026 | √ Element <//span[contains(@class, "oc-file-name") and text()='simple-folder' and not(../span[contains(@class, "oc-file-extension")])]/ancestor::div[@data-is-visible="true"]//div[contains(@class, "oc-file") and (@data-preview-loaded="true" or @data-preview-loaded="disabled")]> was visible after 46 milliseconds.
1027 | ✖ failed
1028 | AssertionError [ERR_ASSERTION]: Expected share indicators to be the same for "simple-folder": expected [user-indirect] got []
1029 | + expected - actual
1030 |  
1031 | -false
1032 | +true
1033 |  
1034 | at _callee58$ (/srv/app/phoenix/tests/acceptance/stepDefinitions/filesContext.js:1081:12)
1035 | at tryCatch (/srv/app/phoenix/node_modules/regenerator-runtime/runtime.js:63:40)
1036 | at Generator.invoke [as _invoke] (/srv/app/phoenix/node_modules/regenerator-runtime/runtime.js:293:22)
1037 | at Generator.next (/srv/app/phoenix/node_modules/regenerator-runtime/runtime.js:118:21)
1038 | at asyncGeneratorStep (/srv/app/phoenix/node_modules/@babel/runtime/helpers/asyncToGenerator.js:3:24)
1039 | at _next (/srv/app/phoenix/node_modules/@babel/runtime/helpers/asyncToGenerator.js:25:9)
1040 | at processTicksAndRejections (internal/process/task_queues.js:86:5)
1041 | When the user opens folder "simple-folder" using the webUI
1042 | - skipped
1043 | Then the following resources should have share indicators on the webUI
1044 | │ fileName            │ expectedIndicators │
1045 | │ simple-empty-folder │ user-indirect      │
1046 | │ lorem.txt           │ user-indirect      │
1047 | - skipped
1048 | deleted Share

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@kulmann @LukasHirt what about the share indicators ... I know they don't work on ocis, yet ... I can try to fix that, but I'd rather get this PR in ... now ...

Copy link
Member

@kulmann kulmann Nov 13, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Currently broken in phoenix master, according to: owncloud/web#4310
Skip it if possible.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Currently the Phoenix UI tests are only run with owncloud storage. So I don't understand? How did it break in CI?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok, share indicators in the file list rely on the <oc:share-types> property, which is not implemented in ocis, yet.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@kulmann wasn't the Phoenix pr supposed to allow this? Ugh I need to really click through this...

@butonic butonic force-pushed the update-reva-to-v1.3.1-0.20201109104617-f47d01b73dec branch from 0be729c to df6011e Compare November 17, 2020 20:03
@phil-davis
Copy link
Contributor

phil-davis commented Nov 18, 2020

https://drone.owncloud.com/owncloud/ocis/1497/42/7 phoenixWebUI5

Failures:

1) Scenario: sharing indicator of items inside an incoming shared folder (attempt 2) # tests/acceptance/features/webUISharingInternalUsers/shareWithUsers.feature:486
   ✔ Before # tests/acceptance/setup.js:28
   ✔ Before # tests/acceptance/setup.js:32
   ✔ Before # tests/acceptance/setup.js:36
   ✔ Before # tests/acceptance/setup.js:46
   ✔ Before # tests/acceptance/setup.js:68
   ✔ Before # tests/acceptance/setup.js:75
   ✔ Before # tests/acceptance/stepDefinitions/filesContext.js:18
   ✔ Before # tests/acceptance/stepDefinitions/generalContext.js:234
   ✔ Before # tests/acceptance/stepDefinitions/generalContext.js:273
   ✔ Given the setting "shareapi_auto_accept_share" of app "core" has been set to "no" # tests/acceptance/stepDefinitions/generalContext.js:185
   ✔ And the administrator has set the default folder for received shares to "Shares" # tests/acceptance/stepDefinitions/sharingContext.js:1417
   ✔ And these users have been created with default attributes: # tests/acceptance/stepDefinitions/provisioningContext.js:199
       | username |
       | user1    |
       | user2    |
   ✔ Given user "user1" has shared folder "simple-folder" with user "user2" # tests/acceptance/stepDefinitions/sharingContext.js:477
   ✔ And user "user2" has accepted the share "simple-folder" offered by user "user1" # tests/acceptance/stepDefinitions/sharingContext.js:1245
   ✔ When user "user2" has logged in using the webUI # tests/acceptance/stepDefinitions/loginContext.js:67
   ✔ And the user opens folder "Shares" using the webUI # tests/acceptance/stepDefinitions/filesContext.js:154
   ✔ And the user opens the sharing sidebar for folder "simple-folder" # tests/acceptance/stepDefinitions/sharingContext.js:1353
   ✖ Then the following resources should have share indicators on the webUI # tests/acceptance/stepDefinitions/filesContext.js:1072
       | fileName      | expectedIndicators |
       | simple-folder | user-indirect      |
       AssertionError [ERR_ASSERTION]: Expected share indicators to be the same for "simple-folder": expected [user-indirect] got []
           + expected - actual

           -false
           +true

           at _callee58$ (/srv/app/phoenix/tests/acceptance/stepDefinitions/filesContext.js:1081:12)
           at tryCatch (/srv/app/phoenix/node_modules/regenerator-runtime/runtime.js:63:40)
           at Generator.invoke [as _invoke] (/srv/app/phoenix/node_modules/regenerator-runtime/runtime.js:293:22)
           at Generator.next (/srv/app/phoenix/node_modules/regenerator-runtime/runtime.js:118:21)
           at asyncGeneratorStep (/srv/app/phoenix/node_modules/@babel/runtime/helpers/asyncToGenerator.js:3:24)
           at _next (/srv/app/phoenix/node_modules/@babel/runtime/helpers/asyncToGenerator.js:25:9)
           at processTicksAndRejections (internal/process/task_queues.js:86:5)
   - When the user opens folder "simple-folder" using the webUI # tests/acceptance/stepDefinitions/filesContext.js:154
   - Then the following resources should have share indicators on the webUI # tests/acceptance/stepDefinitions/filesContext.js:1072
       | fileName            | expectedIndicators |
       | simple-empty-folder | user-indirect      |
       | lorem.txt           | user-indirect      |
   ✔ After # tests/acceptance/stepDefinitions/provisioningContext.js:226
   ✔ After # tests/acceptance/stepDefinitions/generalContext.js:285
   ✔ After # tests/acceptance/stepDefinitions/generalContext.js:258
   ✔ After # tests/acceptance/setup.js:110
   ✔ After # tests/acceptance/setup.js:106
   ✔ After # tests/acceptance/setup.js:102
   ✔ After # tests/acceptance/setup.js:95
   ✔ After # tests/acceptance/setup.js:86
   ✔ After # tests/acceptance/setup.js:54

2) Scenario: see resource owner for direct shares in "shared with me" (attempt 2) # tests/acceptance/features/webUISharingInternalUsers/shareWithUsers.feature:681
   ✔ Before # tests/acceptance/setup.js:28
   ✔ Before # tests/acceptance/setup.js:32
   ✔ Before # tests/acceptance/setup.js:36
   ✔ Before # tests/acceptance/setup.js:46
   ✔ Before # tests/acceptance/setup.js:68
   ✔ Before # tests/acceptance/setup.js:75
   ✔ Before # tests/acceptance/stepDefinitions/filesContext.js:18
   ✔ Before # tests/acceptance/stepDefinitions/generalContext.js:234
   ✔ Before # tests/acceptance/stepDefinitions/generalContext.js:273
   ✔ Given the setting "shareapi_auto_accept_share" of app "core" has been set to "no" # tests/acceptance/stepDefinitions/generalContext.js:185
   ✔ And the administrator has set the default folder for received shares to "Shares" # tests/acceptance/stepDefinitions/sharingContext.js:1417
   ✔ And these users have been created with default attributes: # tests/acceptance/stepDefinitions/provisioningContext.js:199
       | username |
       | user1    |
       | user2    |
   ✔ Given user "user1" has shared folder "simple-folder" with user "user2" # tests/acceptance/stepDefinitions/sharingContext.js:477
   ✔ And user "user2" has accepted the share "simple-folder" offered by user "user1" # tests/acceptance/stepDefinitions/sharingContext.js:1245
   ✔ And user "user2" has logged in using the webUI # tests/acceptance/stepDefinitions/loginContext.js:67
   ✔ When the user browses to the shared-with-me page # tests/acceptance/stepDefinitions/filesContext.js:34
   ✔ And the user opens the share dialog for folder "simple-folder" using the webUI # tests/acceptance/stepDefinitions/sharingContext.js:890
   ✖ Then user "User One" should be listed as "Owner" in the collaborators list on the webUI # tests/acceptance/stepDefinitions/sharingContext.js:947
       AssertionError [ERR_ASSERTION]: "User One" with type "user" was expected to be in share list but was not present. Found collaborators: name=User Two type=User
           at /srv/app/phoenix/tests/acceptance/stepDefinitions/sharingContext.js:281:16
           at processTicksAndRejections (internal/process/task_queues.js:86:5)
   ✔ After # tests/acceptance/stepDefinitions/provisioningContext.js:226
   ✔ After # tests/acceptance/stepDefinitions/generalContext.js:285
   ✔ After # tests/acceptance/stepDefinitions/generalContext.js:258
   ✔ After # tests/acceptance/setup.js:110
   ✔ After # tests/acceptance/setup.js:106
   ✔ After # tests/acceptance/setup.js:102
   ✔ After # tests/acceptance/setup.js:95
   ✔ After # tests/acceptance/setup.js:86
   ✔ After # tests/acceptance/setup.js:54

That was the only failing pipeline. I restarted drone - let's see if the same scenarios fail again.

@phil-davis
Copy link
Contributor

https://drone.owncloud.com/owncloud/ocis/1500/42/7
Exactly the same 2 scenarios failed as in the post above.
So this looks like a real issue.

@butonic butonic force-pushed the update-reva-to-v1.3.1-0.20201109104617-f47d01b73dec branch from df6011e to f2e7ade Compare November 18, 2020 14:56
@butonic
Copy link
Member Author

butonic commented Nov 18, 2020

@phil-davis yes I excpect them to be fixed with the rebase on top of #868

@phil-davis phil-davis self-requested a review November 18, 2020 15:16
@butonic butonic force-pushed the update-reva-to-v1.3.1-0.20201109104617-f47d01b73dec branch from 87b8f8d to 1fc893f Compare November 18, 2020 15:17
@butonic butonic changed the title Update reva to v1.3.1-0.20201112131316-1c425035c8a2 Update reva to v1.4.1-0.20201118150422-667197a6b674 Nov 18, 2020
@@ -0,0 +1,17 @@
Enhancement: Update reva to v1.4.0
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Enhancement: Update reva to v1.4.0
Enhancement: Update reva to v1.4.1

And now it is 1.4.1 !

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

See comment below by @kulmann
This can be updated when we finally get to a "version" for what will pass here.

@butonic butonic force-pushed the update-reva-to-v1.3.1-0.20201109104617-f47d01b73dec branch from 1fc893f to ce61c57 Compare November 18, 2020 16:06
@kulmann
Copy link
Member

kulmann commented Nov 19, 2020

Would be nice to get this in as well: cs3org/reva#1326

@kulmann
Copy link
Member

kulmann commented Nov 19, 2020

By the way, we're not updating to reva 1.4.1 here, but to "some commit after the 1.4.0 tag". Go expresses that by increasing the patch version and appending the commit id.

butonic and others added 9 commits November 23, 2020 12:56
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
@kulmann kulmann force-pushed the update-reva-to-v1.3.1-0.20201109104617-f47d01b73dec branch from 837fc94 to 1621a0d Compare November 23, 2020 11:56
@sonarcloud
Copy link

sonarcloud bot commented Nov 23, 2020

Kudos, SonarCloud Quality Gate passed!

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities (and Security Hotspot 0 Security Hotspots to review)
Code Smell A 0 Code Smells

No Coverage information No Coverage information
No Duplication information No Duplication information

@phil-davis phil-davis merged commit 6b07aed into owncloud:master Nov 23, 2020
ownclouders pushed a commit that referenced this pull request Nov 23, 2020
Merge: b614ad1 1621a0d
Author: Phil Davis <phil@jankaritech.com>
Date:   Mon Nov 23 18:42:32 2020 +0545

    Merge pull request #823 from butonic/update-reva-to-v1.3.1-0.20201109104617-f47d01b73dec

    Update reva to v1.4.1-0.20201118150422-667197a6b674
@butonic butonic deleted the update-reva-to-v1.3.1-0.20201109104617-f47d01b73dec branch June 8, 2022 11:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants