Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Representation of parameter batching in OPIL #142

Open
jgladwig opened this issue Feb 17, 2021 · 3 comments
Open

Representation of parameter batching in OPIL #142

jgladwig opened this issue Feb 17, 2021 · 3 comments

Comments

@jgladwig
Copy link

jgladwig commented Feb 17, 2021

I have been converting the strateos experiment params from being output as json to instead be output as OPIL. The previous json representation would output parameters in 'batches' where each batch represented some grouping that should be executed together due to some shared parameter value within that batch (e.g. identical media or identical temperature). My understanding is that part of the goal here is to ensure that one batch is processed in its entirety before the next batch is processed.

@danbryce can provide an extended description of what the batches represent and how they are currently used.

The end goal for this issue is to determine how to best represent this batching behavior within OPIL.

@danbryce
Copy link

XPlan produces an experiment design where each measurement (row in the experiment design table) has a batch id. The batch id corresponds to a single invocation at a lab. We can express the measurements as a table and add a column for batch_id or somehow group the measurements by batch (e.g., have a table for each batch).

@jakebeal
Copy link

jakebeal commented Feb 24, 2021

The model here appears to be that Intent Parser is giving one ExperimentRequest object, which then XPlan then splits into several ExperimentRequest documents. The split is guided by hints provided by the user in a column.

A near-term kludge that works for this is having a batch column, which goes as a custom marker.

A better longer-term approach will be to have Intent Parser able to export multiple experiment requests, but we aren't there yet.

@danbryce
Copy link

danbryce commented Feb 26, 2021 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants