Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Post-pruning optimization to CART #4

Closed
andrewdalpino opened this issue Nov 4, 2018 · 0 comments
Closed

Post-pruning optimization to CART #4

andrewdalpino opened this issue Nov 4, 2018 · 0 comments
Assignees
Labels
enhancement New feature or request
Projects

Comments

@andrewdalpino
Copy link
Member

The current implementation of CART (Classification and Regression Tree) only utilizes pre-pruning tactics to control overfitting. It has been shown that combining pre-pruning and post-pruning can achieve better regularization effects while speeding up inference. I propose a lightweight heuristic that will work with the impurity system already in place such that nodes with minimal impurity decrease can be pruned.

I am open to other suggestions.

@andrewdalpino andrewdalpino added the enhancement New feature or request label Nov 4, 2018
@andrewdalpino andrewdalpino self-assigned this Nov 4, 2018
@andrewdalpino andrewdalpino added this to Backlog in Roadmap via automation Nov 4, 2018
@andrewdalpino andrewdalpino moved this from Backlog to Review in Roadmap Nov 8, 2018
@andrewdalpino andrewdalpino moved this from Review to Completed in Roadmap Nov 8, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
No open projects
Roadmap
  
Completed
Development

No branches or pull requests

1 participant