Decomposedfs treesizecheck

[rhafer]

This adds a cli command to verify the treesize metadata of a Space in decomposedfs

ocis decomposedfs check-treesize -r /root/.ocis/storage/users/ -n cc1a4ba9-75d5-43e7-853c-548e1726ef60
Checking treesizes in space: Admin (id: cc1a4ba9-75d5-43e7-853c-548e1726ef60)
treesizes mismatch for node: /test2/folder/folder/folder/folder/folder
        NodeId: 2f8d8188-8c66-4c4d-a29b-cee85e3097c3
        InternalPath: /root/.ocis/storage/users/spaces/cc/1a4ba9-75d5-43e7-853c-548e1726ef60/nodes/2f/8d/81/88/-8c66-4c4d-a29b-cee85e3097c3
        calculated treesize: 1998
        treesize in metadata: 1996
treesizes mismatch for node: /test2/folder/folder/folder/folder
        NodeId: 73ccc33f-0a8b-4513-9e2c-161a9e551279
        InternalPath: /root/.ocis/storage/users/spaces/cc/1a4ba9-75d5-43e7-853c-548e1726ef60/nodes/73/cc/c3/3f/-0a8b-4513-9e2c-161a9e551279
        calculated treesize: 1998
        treesize in metadata: 1996
treesizes mismatch for node: /test2/folder/folder/folder
        NodeId: 0b95ed50-1ff4-4e01-a23f-eb48a4bd8691
        InternalPath: /root/.ocis/storage/users/spaces/cc/1a4ba9-75d5-43e7-853c-548e1726ef60/nodes/0b/95/ed/50/-1ff4-4e01-a23f-eb48a4bd8691
        calculated treesize: 1998
        treesize in metadata: 1996
treesizes mismatch for node: /test2/folder/folder
        NodeId: fb24f75a-511a-4d60-9c09-00771e49c590
        InternalPath: /root/.ocis/storage/users/spaces/cc/1a4ba9-75d5-43e7-853c-548e1726ef60/nodes/fb/24/f7/5a/-511a-4d60-9c09-00771e49c590
        calculated treesize: 1998
        treesize in metadata: 1996
treesizes mismatch for node: /test2/folder
        NodeId: 8b4f9187-1510-400c-85e2-9f3534a9f2fb
        InternalPath: /root/.ocis/storage/users/spaces/cc/1a4ba9-75d5-43e7-853c-548e1726ef60/nodes/8b/4f/91/87/-1510-400c-85e2-9f3534a9f2fb
        calculated treesize: 1998
        treesize in metadata: 1996
treesizes mismatch for node: /test2
        NodeId: 8cb2f568-b890-480d-88a6-e356b589747a
        InternalPath: /root/.ocis/storage/users/spaces/cc/1a4ba9-75d5-43e7-853c-548e1726ef60/nodes/8c/b2/f5/68/-b890-480d-88a6-e356b589747a
        calculated treesize: 1998
        treesize in metadata: 1996
treesizes mismatch for space: Admin
        NodeId: cc1a4ba9-75d5-43e7-853c-548e1726ef60
        InternalPath: /root/.ocis/storage/users/spaces/cc/1a4ba9-75d5-43e7-853c-548e1726ef60/nodes/cc/1a/4b/a9/-75d5-43e7-853c-548e1726ef60
        calculated treesize: 93692124
        treesize in metadata: 93692118

It's meant for offline usage. E.g. for analyzing case like: https://github.com/owncloud/enterprise/issues/5783

Using it while the ocis server is running is possible but might produce inconsistent results, when e.g. files are being uploaded/copied/deleted while the tool is running.

[update-docs]

Thanks for opening this pull request! The maintainers of this repository would appreciate it if you would create a changelog item based on your changes.

[ownclouders]

💥 Acceptance test localApiTests-apiCors-ocis failed. Further test are cancelled...

[rhafer]

BTW, I'd welcome ideas for how we could make this less disruptive. The current requirement to run this while the service is offline is not really practical, especially when the space is really large.

To somewhat reduce downtime it is already possible to run the tool without --repair to find out which spaces actually need repair, while the server is running. It might produce a couple of false positives (especially for busy spaces), but should still help.

[kobergj]

Looks good to me. Just nitpicking for cosmetic change.

[sonarcloud]

Kudos, SonarCloud Quality Gate passed!   

0 Bugs
0 Vulnerabilities
0 Security Hotspots
1 Code Smell

0.0% Coverage
0.0% Duplication

[rhafer]

BTW, I'd welcome ideas for how we could make this less disruptive. The current requirement to run this while the service is offline is not really practical, especially when the space is really large.

I've created #6603 as a followup issue on this.