We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 2c7bfa9 commit 7c70cf6Copy full SHA for 7c70cf6
README.md
@@ -232,3 +232,15 @@ Gradient Boosted Regression:
232
233
Gradient Boosted Classication:
234
- In sklearn: GradientBoostingClassifier .
235
+
236
+Gradient Boosting: Cons
237
+- GB involves an exhaustive search procedure.
238
+- Each CART is trained to find the best split points and features.
239
+- May lead to CARTs using the same split points and maybe the same features.
240
241
+Stochastic Gradient Boosting
242
+- Each tree is trained on a random subset of rows of the training data.
243
+- The sampled instances (40%-80% ofthe training set) are sampled without replacement.
244
+- Features are sampled (without replacement) when choosing split points.
245
+- Result: further ensemble diversity.
246
+- Effect: adding further variance to the ensemble oftrees.
0 commit comments