Solution for iterating over data needed (e.g. iterating over DataGenerators in RepeatedTasks)

[matthiaskoenig]

Issue

In L1V3 it is possible to read data and plot it, i.e. generate a DataGenerator and use it for output. What is missing is a solution to parametrize simulations/tasks, i.e. use the data within the tasks/simulations.
This is the very important use case of storing parameter sets and sets of initial concentrations in data files and than drive the model with this data.
Somehow it is not possible with the current specification to iterate over a dataGenerators in a range.

This would also be very helpful to iterate over data in DataGenerators from other sources and provide very interesting functionality:

• iterating over interpolated data ( Interpolation (Definition and DataGenerator) #24 )
• iterating over data from distributions ( Distributions (define distributions & use values from distributions in repeatedTasks) #23 )

Examples

A classical example would be

• reading data in DataSource, for instance patient data/records to personalize the model`
• create RepeatedTask using a FunctionalRange with the DataSource as variable
• use this dataRange to set Parameter/InitialConcentration in every repeat
  Other examples
• iterating over interpolated data ( Interpolation (Definition and DataGenerator) #24 )
• iterating over data from distributions ( Distributions (define distributions & use values from distributions in repeatedTasks) #23 )

Proposals

Introduce an additional range which allows to iterate over a dataGenerator, i.e. would iterate over all values in the dataGenerator

DataGeneratorRange(Range):
    dataSource: SIdRef (DataGenerator)

Such a DataGeneratorRange would allow to define repeated tasks based on Data in DataGenerators. No circular referencing would be allowed.

Ranges:
https://docs.google.com/drawings/d/1bgGu_Pty0k_8xX2CS611rmP33jZTVbW326FIgFPXRzc/edit

[luciansmith]

HARMONY 2018: This should already be possible with the use of a DataSource within a DataDescription. Within a RepeatedTask, the SetValue will reference the DataSource #id.

[luciansmith]

You also have to use FunctionalRange to tell the repeated task how many times to repeat.

[luciansmith]

As far as I can tell, this issue has indeed been addressed (and beyond) and everything should be possible in l1v4.