[MRG] FIX use a stump as base estimator in RUSBoostClassifier#545
Conversation
| return self | ||
|
|
||
| def _validate_estimator(self, default=DecisionTreeClassifier()): | ||
| def _validate_estimator(self, default=DecisionTreeClassifier(max_depth=1)): |
There was a problem hiding this comment.
I think that you are right. We should actually call the parent class then:
https://github.com/scikit-learn/scikit-learn/blob/7389dba/sklearn/ensemble/weight_boosting.py#L414
|
@glemaitre do you have any clue why this test is failing? Isn't it weird? |
Codecov Report
@@ Coverage Diff @@
## master #545 +/- ##
==========================================
- Coverage 98.88% 98.83% -0.06%
==========================================
Files 84 82 -2
Lines 5184 5043 -141
==========================================
- Hits 5126 4984 -142
- Misses 58 59 +1
Continue to review full report at Codecov.
|
|
@glemaitre early stopping issue |
|
@glemaitre as you can see using a stump as the default estimator I believe that the performance ain't so good. So, what do you propose? To make a benchmark using stump and a full decision tree and decide then, make the stump default to be in line with scikit-learn or leave the full grown tree as default? |
What does this implement/fix? Explain your changes.
I don't think that the referenced paper mentions something about stumps but this change keep us in line with the original implementation of
AdaBoostClassifier