[Feature Request]: Add ability to delete data from Project

[george0st]

Feature Type

• Adding new functionality to MLRun

• Changing existing functionality in MLRun

• Removing existing functionality in MLRun

Problem Description

When I delete the project from GUI, everything is deleted (own project, jobs, artefacts, etc.) except the data.

And the information in dialog is not fully readable (it is not about delete of all resources under the project), see the information from GUI:

You try to delete project "jist-from-local". 'The project is not empty. Deleting it will also delete all of its resources, such as jobs, 'artifacts, and features.

BTW: It is necessity to delete data (e.g. parquet files) manually e.g. via linux commands in specific directories and in case of delete missing (it can generate garbage in file system).

Feature Description

It will be useful to have ability to delete also data stored directly in project directory (parquet files, kv files, etc.).

Alternative Solutions

Add note to the delete dialog, that project data (parquets, ...) are out of delete procedure and have to be deleted manually.

Additional Context

No response

[gilad-shaham]

I'm going to open a ticket that we address the UI first to make it clearer that deletion applies just to the MLRun objects and not the actual data.
WRT the data deletion from the file system, I'm not sure we can guarantee full data deletion for all use cases and all storage types. There are many corner cases here that can complicate this. However, I'll check if there is any approach that we can take that will be consistent and clear.

[george0st]

@gilad-shaham , many thanks. Delete data only in project folder will be enough (without edge cases, where parquet files will be located in e.g. different container or shared projects, etc.)

[george0st]

#4038