Change proposal, keep all reports

[klodoma]

In the current situation the html_report contains always the latest report and the older reports are lost.

I propose to add a "flag" where the html_report folder gets a similar structure to the bitmaps_test folder (with timestamps as sub-folders) which contains then the actual reports.

This helps if one executes the test repeatedly and want to see the diffs.

Any thoughts against such a feature?

[garris]

@klodoma yes, I am supportive. Others have asked for this as well. It could be as simple as an operation which runs after the current reporting flow completes and copies all dependent assets into an additional html_report directory structure.

SideNote: I personally don't have a big problem with redundant assets floating around to ensure backwards compatibility e.g. duplicating (not moving) assets into directories in the html_report directory are fine with me -- but issues with asset sizes sometimes come up for others. That said, I would approach any concerns of cleaning up old/redundant file bloat as a separate housecleaning problem.

[klodoma]

@garris I agree with redundancy, this is not something one will always use.

We could add a flag like: keepReports: true or reportsHistory: true, I would go with the former.

[garris]

I like keepReports -- but maybe archiveReports is a little more accurate (cause we would literally be creating self-contained report archives.)

[nicolasgasco]

Hello, everyone! Is this feature still available?

We're struggling with generating an HTML report that includes all timestamped directories and not simply the latest one.

We tried activating the flag introduced in the MR attached to this issue, but to no avail. The description of this issue, though, fit exactly our needs.

A colleague of mine left another comment in another issue with more context on what we're trying to achieve: #1265 (comment)