Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix lost trials of parents #637

Merged
merged 7 commits into from
Aug 23, 2021

Conversation

bouthilx
Copy link
Member

[Fixes #577]

Why:

When running an experiment, the parents may have lost trials that are
stuck to status reserved. If the user cannot run the parents, it must
then use orion db set to fix this manually. This should be done
automatically instead.

How:

Loop over the EVC and call fix_lost_trials for each experiments. Note
that this can increase significantly the cost of the command for large
EVC.

A ugly hack is used to allow running fix_lost_trials on the parents
that are in read mode. It would be great to find a better work around...

Why:

When running an experiment, the parents may have lost trials that are
stuck to status reserved. If the user cannot run the parents, it must
then use `orion db set` to fix this manually. This should be done
automatically instead.

How:

Loop over the EVC and call `fix_lost_trials` for each experiments. Note
that this can increase significantly the cost of the command for large
EVC.

A ugly hack is used to allow running `fix_lost_trials` on the parents
that are in read mode. It would be great to find a better work around...
@bouthilx bouthilx added the bug Indicates an unexpected problem or unintended behavior label Aug 20, 2021
@bouthilx bouthilx added this to the v0.1.16 milestone Aug 20, 2021
@bouthilx bouthilx merged commit 76656ea into Epistimio:develop Aug 23, 2021
@bouthilx bouthilx deleted the hotfix/parent_heartbeat branch August 23, 2021 17:32
@bouthilx bouthilx mentioned this pull request Aug 23, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Indicates an unexpected problem or unintended behavior
Projects
None yet
Development

Successfully merging this pull request may close these issues.

The trials hearbeat of parent experiments are not verified
1 participant