File tree Expand file tree Collapse file tree 1 file changed +15
-2
lines changed
Expand file tree Collapse file tree 1 file changed +15
-2
lines changed Original file line number Diff line number Diff line change @@ -212,10 +212,23 @@ Adaboost
212212- Learning rate: 0 < η ≤ 1. It help to shrink coeeficient α. It is the tradeoff between η and number of estimator.
213213- Smaller number of η should be compensiated by high number of estimator.
214214
215- AdaBoost Classication:
215+ AdaBoost Classication
216216- Weighted majority voting.
217217- In sklearn: AdaBoostClassifier.
218218
219- AdaBoost Regression:
219+ AdaBoost Regression
220220- Weighted average.
221221- In sklearn: AdaBoostRegressor.
222+
223+ Gradient Boosted Trees
224+ - Sequential correction of predecessor's errors.
225+ - Does not tweak the weights of training instances.
226+ - Fit each predictor is trained using its predecessor's residual errors as labels.
227+ - Gradient Boosted Trees: a CART is used as a base learner.
228+
229+ Gradient Boosted Regression:
230+ - y = y + ηr + ... + ηr
231+ - In sklearn: GradientBoostingRegressor .
232+
233+ Gradient Boosted Classication:
234+ - In sklearn: GradientBoostingClassifier .
You can’t perform that action at this time.
0 commit comments