[Feature Request]: Execution Information Location: retention policy (by count / by days)

[CarlosJuncher03]

What would you like to happen?

Problem
Execution Information Location keeps accumulating execution records (e.g., log_file location) without built-in retention controls. In long-running production usage this increases disk usage and makes later analysis/navigation slower.

Proposal
Add optional retention settings to Execution Information Location metadata:

Retention by count: keep last N executions per pipeline/workflow (or per location), delete older records automatically.

Retention by age: keep executions for last X days, delete older records automatically.

Option to choose scope:

per “location” (global)

per pipeline/workflow name (recommended)

Acceptance criteria

When retention is enabled, older execution records are removed automatically.

Deletion should be safe: remove only records belonging to the configured location.

Works for “local/log_file” execution information location and any other supported backend.

Retention runs:

on write (after storing a new execution), and/or

as a periodic cleanup task (configurable)

Notes / rationale
This supports production hygiene and avoids external scripts for rotation/cleanup.

Issue Priority

Priority: 3

Issue Component

Component: Hop Gui, Component: Metadata

[hansva]

For this one, I would not run this every time the hop-run triggers, as it will have performance drawbacks.
This should be run only when the GUI is opened or using a separate command via hop-config

[CarlosJuncher03]

It would be good by command. That way it would stay adjusted in the orchestrator.

[mattcasters]

I'm equally torn. In the old database logging variant in the Previous Data Integration variant, automatic cleanup was a real pain.
I personally think that it's easier to just create a workflow or pipeline that removes old files, index entries or nodes/relationships from the execution information location of your choice.
A compromise would be to have a dedicated action that can remove data from an execution information location.