Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AutoML should skip/ignore trainers that don't work on the current machine #5576

Open
eerhardt opened this issue Jan 4, 2021 · 2 comments
Open
Labels
AutoML.NET Automating various steps of the machine learning process enhancement New feature or request P2 Priority of the issue for triage purpose: Needs to be fixed at some point.

Comments

@eerhardt
Copy link
Member

eerhardt commented Jan 4, 2021

Following up from #3903 (comment).

We should consider not failing an AutoML experiment because the dependencies necessary for MKL to load are not available on the current machine. We could log a warning or tell the user some other way that MKL can't be loaded. But this shouldn't block the user, and force them to figure out how to exclude the problematic trainer (Ols in the case above).

@justinormont
Copy link
Contributor

There is a Try/Catch around the fitting of the pipeline in AutoML. Does this catch the MLK error? If so, AutoML will keep using the trainers remaining trainers.

@michaelgsharp
Copy link
Member

Based on that issue thread it didn't look like it was catching the error. Maybe the error is coming from loading one of the transformers instead of when fit is called directly?

One thought, maybe in the PipelineSuggester.GetNextInferredPipeline we can do those checks and not even return those pipelines? Or would that be too hard to check for so it would just be better to figure out exactly where its happening and just catch it there?

@michaelgsharp michaelgsharp added AutoML.NET Automating various steps of the machine learning process enhancement New feature or request P2 Priority of the issue for triage purpose: Needs to be fixed at some point. labels Jan 12, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
AutoML.NET Automating various steps of the machine learning process enhancement New feature or request P2 Priority of the issue for triage purpose: Needs to be fixed at some point.
Projects
None yet
Development

No branches or pull requests

3 participants