Archiving all runs history of the Finesse Benchmark Tool to Datahub

[ibrahim-kabir]

Summary

The Finesse benchmark tool currently saves test data locally, which hinders archiving all runs history for comparison with historical performance data. Moreover, not all data is captured in the CSV or Markdown files, as there is an overflow of responses from Finesse. Hence, it would be beneficial to migrate this data storage to a database solution.

Tasks

• Create a schema on Datahub
• Modify the script to connect to Datahub and save data on table
• Test the migration process thoroughly with test.

Acceptance Criteria

• Ensure all test data from Finesse benchmarking is successfully migrated to a PostgreSQL database.
• Develop a script or tool to automate the process of saving data to the PostgreSQL table.
• Verify that all data is accurately captured and stored in the database without any loss or truncation.
• Implement error handling mechanisms to address any potential issues during data migration.
• Conduct thorough testing to validate the functionality and reliability of the PostgreSQL database for storing Finesse benchmark test data.
• Document the migration process and provide clear instructions for future maintenance and updates.

[rngadam]

I wouldn't express it primarily as a "data loss risk" (information has no business value), more about archiving all runs history to enable comparison with historical performance data.