Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is it possible to auto-compare different models? #40

Closed
CWen001 opened this issue Apr 11, 2022 · 2 comments
Closed

Is it possible to auto-compare different models? #40

CWen001 opened this issue Apr 11, 2022 · 2 comments
Labels
enhancement New feature or request

Comments

@CWen001
Copy link

CWen001 commented Apr 11, 2022

Hello, and thanks for this nice package. After using pycaret in python, I found lares quite convenient to finish the low-code auto-ML jobs.

A question about the functionality, Please. Is it possible for lares to compare different models? This is one killer feature of pycaret with the help of compare_models(), which gives the user a summary table. For simple academic use, it also helps demonstrate how different models perform as a fast exploration.

@laresbernardo
Copy link
Owner

Hi @CWen001 thanks for your nice feedback.

Given your comparing model request, I have in mind two possible ways to do so:

  1. When running h2o_automl() you'll get a leaderboard will all the generated models and a dataframe that compares the main metric chosen to pick the winner

  2. We have model_metrics() function that will give you a bunch of metrics you can use to compare any model. You'd have to run that for each model you'd like to compare and gather them up in a summary table. Feel free to develop this as a function and we could implement it in lares.

Cheers!

@laresbernardo laresbernardo added the enhancement New feature or request label Apr 11, 2022
@laresbernardo
Copy link
Owner

Closing for now...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants