[NEW] GDPR - Right to access and Data Portability

[Hudell]

@RocketChat/core

Closes #9767
Closes #9768

This PR adds an option for users to download all their data stored in the servers, in either JSON or HTML format. This funcionality can be enabled by an admin through a new page on the administration center.

Once enabled, two new buttons will be added to the user's account page:

When the user clicks on one of those new buttons, the system will register the request on the new exportOperations collection. The server will then automatically export all the messages and attachments from every channel that the user has access to. When this operation is complete, the server will generate a zip file and send an email to the user with a download link.

Each button can only be used once per day. The download button will generate HTML files and the export button will generate JSON files.

[geekgonecrazy]

We are making a lot of assumptions about long term storage being available on the disk. Could we store the file on the file store provider already setup on the server?

Let's just imagine that this is in a docker container. If you write the file and then the container is restarted the file is gone. Mounting a directory is possible... But in some setups this is pretty difficult

[Hudell]

I've added GridFS, Amazon and Google Storage as options for the location of the generated file.

[ghost]

Just tried that but I get internal server error +

Exception while invoking method 'requestDataDownload' Error: ENOENT: no such file or directory, mkdir '/tmp/userData/HxSazvfL5T6vRHP8K'
    at Object.fs.mkdirSync (fs.js:885:18)
    at MethodInvocation.requestDataDownload (/opt/rocketchat-0.64.0/programs/server/app/app.js:10356:10)
    at MethodInvocation.methodMap.(anonymous function) (packages/rocketchat_monitoring.js:2731:30)
    at MethodInvocation.methodsMap.(anonymous function) (/opt/rocketchat-0.64.0/programs/server/packages/rocketchat_lib.js:2186:28)
    at maybeAuditArgumentChecks (/opt/rocketchat-0.64.0/programs/server/packages/ddp-server.js:1877:12)
    at DDP._CurrentMethodInvocation.withValue (/opt/rocketchat-0.64.0/programs/server/packages/ddp-server.js:902:126)
    at Meteor.EnvironmentVariable.EVp.withValue (packages/meteor.js:1186:12)
    at DDPServer._CurrentWriteFence.withValue (/opt/rocketchat-0.64.0/programs/server/packages/ddp-server.js:902:98)
    at Meteor.EnvironmentVariable.EVp.withValue (packages/meteor.js:1186:12)
    at Promise (/opt/rocketchat-0.64.0/programs/server/packages/ddp-server.js:902:46)
    at new Promise (<anonymous>:null:null)
    at Session.method (/opt/rocketchat-0.64.0/programs/server/packages/ddp-server.js:875:23)
    at /opt/rocketchat-0.64.0/programs/server/packages/ddp-server.js:754:85

[ghost]

Creating /tmp/userData solves that. Hm.

[photoninger]

mkdir -p would avoid such errors

[Elvinra]

On docker same problem, the user rocketchat don't have the permissions on tmp folder

• little fix: Mount a volume on /tmp/userData, put chmod 777 on the host system

Real fix: update the dockerfile to create that folder and put the permissions to rocketchat user

[photoninger]

When are the exported files and zip files deleted?
Or do you depend on deleting everything in /tmp on reboot?