Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

mlr3 learner train / predict timeout #542

Closed
mb706 opened this issue Aug 17, 2020 · 5 comments
Closed

mlr3 learner train / predict timeout #542

mb706 opened this issue Aug 17, 2020 · 5 comments

Comments

@mb706
Copy link
Collaborator

mb706 commented Aug 17, 2020

When using "callr" encapsulation for learners, callr::r is used so we should in be able to have a training / prediction timeout for that learner. This would be necessary to make mlr3automl (which @a-hanf is working on) more robust against timeouts / stalling Learners.

@RaphaelS1
Copy link
Contributor

I'm not sure if this is related or a separate issue, but a time-out feature could also help in situations such as #501 where benchmarking is crashing due to conflicting parallelisation methods

@mllg
Copy link
Sponsor Member

mllg commented Sep 29, 2020

Timeout now supported in mlr3misc's invoke() and encapsulate(). I will implement it here once mlr3misc is on CRAN.

@RaphaelS1
Copy link
Contributor

Timeout now supported in mlr3misc's invoke() and encapsulate(). I will implement it here once mlr3misc is on CRAN.

Will this detect timeouts due to parallelisation? I know the logger doesn't handle this well which is why I'm checking

@jakob-r
Copy link
Sponsor Member

jakob-r commented Jan 29, 2021

@mllg What's the current status?

@mllg
Copy link
Sponsor Member

mllg commented Jan 29, 2021

It is possible to set learner$timeout. Not yet possible on the resample/benchmark level (#576).

@mllg mllg closed this as completed Jan 29, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants