What should be possible with the output formats ?

[rbiswas4]

It is clear that we will need two files per output:

• A parameter/summary file which has a single record per object which may be a number of tables in a sql database or a nosql database or a hdf file
• A light curve data file which has a single record per observation of an object

The functionality that we would like to have for each of these files are:

with the parameter file:

• query different combinations and regions of the parameter space described by the file
• be able to join information in a table written by doing some analysis with this table

with the light curve data file

• query observations which satisfy a certain criteria across the entire and collect the SN which were observed (eg. SNR greater than a certain value): aggregate/reduction operation
• quickly obtain the observations corresponding to a SN: query on snid and retrieve the data in a pandas.dataFrame

Combined Functionality:

• Create random sub_samples of objects in a portable format. This could be a random sub_sample on the parameters file and then extract the light curves corresponding to the SN. It could also be those light curve observations within a certain period of time for a subset of or all of the SN.
• All output formats should be such that small parts can be extracted as pd.dataFrames, and be rewritten to disk as csv like files for visual inspection (this will not be a common operation, but should be possible for people to inspect these.).
• obtain parameters from summary, analysis results from analysis table and light curve from light curve table