It would be nice to have the warm_start option, as in gradient boosting and soon in the random forest module (see also #3364 and #3409).
I am working on this one.
@ldirer Could I take this up if you aren't working on it? :)
@ragv Sure !
Done in #4500