Skip to content

Commit 7c70cf6

Browse files
Update README.md
1 parent 2c7bfa9 commit 7c70cf6

File tree

1 file changed

+12
-0
lines changed

1 file changed

+12
-0
lines changed

README.md

+12
Original file line numberDiff line numberDiff line change
@@ -232,3 +232,15 @@ Gradient Boosted Regression:
232232

233233
Gradient Boosted Classication:
234234
- In sklearn: GradientBoostingClassifier .
235+
236+
Gradient Boosting: Cons
237+
- GB involves an exhaustive search procedure.
238+
- Each CART is trained to find the best split points and features.
239+
- May lead to CARTs using the same split points and maybe the same features.
240+
241+
Stochastic Gradient Boosting
242+
- Each tree is trained on a random subset of rows of the training data.
243+
- The sampled instances (40%-80% ofthe training set) are sampled without replacement.
244+
- Features are sampled (without replacement) when choosing split points.
245+
- Result: further ensemble diversity.
246+
- Effect: adding further variance to the ensemble oftrees.

0 commit comments

Comments
 (0)