Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LinearTree does not fit well #37

Closed
dieguisgs opened this issue Oct 6, 2023 · 3 comments
Closed

LinearTree does not fit well #37

dieguisgs opened this issue Oct 6, 2023 · 3 comments

Comments

@dieguisgs
Copy link

Hi There!

I was handling with the library when i figured out that the LinearTree doesnt fit to the data, triying to overfitting it. Like in the following image:

image

¿Is there a reason for that?

Thanks

@cerlymarco
Copy link
Owner

Hi,
The splits are computed until there is "some utility" and at least 3 points are available. In other words, if an improvement (a decrease in loss of 1e-5) is detected by adding a split the model continues to grow. If not, the model remains as is.
In the left part of your plot, these conditions are not met.
I suggest you to check also your model summary.
If you support the project don't forget to leave a star ;-)

@dieguisgs
Copy link
Author

And it makes any sense that there is no improvement? Just by wathing the chart. My objective is to overfiti it in max_depth. So it learn all the data.

I appreciate any comment

:)

@cerlymarco
Copy link
Owner

Maybe yes, if you simply want to overfit them a simple DecisionTreeRegressor from sklearn suits well

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants