List view
The current infrastructure is designed to store specific experiment metrics which are related to elevation and regions. We would like to extend our ability to monitor experiment progress in other ways by storing the count of files produced by an experiment. For example, in the replay experiments, it could be beneficial to view the count the number of files produced for each cycle or the number of ocean or atmosphere files produced for a day, week or month. In order to accomplish this, the database infrastructure needs to be extended to handle this new date type. File counts will be associated with file types (such as netcdf or ocean), storage locations (such as AWS S3 or HPSS), and experiments (which is already supported by the current experiment design). New infrastructure needed includes table designs for the file types, storage locations, and file counts; new scripts to facilitate inserting and retrieving data into each of the new tables and the dependencies between the tables themselves; tests related to the new tables.
Overdue by 2 year(s)•Due by April 28, 2023•3/3 issues closed