RaaS: Add existing project files to datasets

[jsam]

Currently, from the service there is only a possibility to add uploaded files to the dataset. We need an option to add existing project files to datasets.

[rokroskar]

There should also be the possibility to do what is currently usually done, which is to add files via a URL. This issue could be generalized to that use-case IMO.

[jsam]

Current /dataset/add endpoint accepts following payload:

{
  "dataset_name": "",
  "create_dataset": true,
  "project_id": "",
  "files": [{
      "file_id": "", 
   }]
}

We should augment this in a way so file object can also be specified via "file_path", for example:

{
  "dataset_name": "",
  "create_dataset": true,
  "project_id": "",
  "files": [{
      "file_id": null,
      "file_path": "", 
   }]
}

In this case, file_path field should be relative to the root of the project and point to the data file which we want to add to a dataset.

[rokroskar]

This makes sense - what happens if both file_id and file_path are passed?

[jsam]

I would say you get the following response:

{
    "error": {
        "code": -32602,
        "reason": "invalid reference found"
    }
}

[rokroskar]

What about a more informative "must use either file_id or file_path but not both"?