Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

backfitting using offset #2438

Open
josef-pkt opened this issue Jun 7, 2015 · 1 comment
Open

backfitting using offset #2438

josef-pkt opened this issue Jun 7, 2015 · 1 comment

Comments

@josef-pkt
Copy link
Member

mainly an idea for some implementation details

GAM or partially additive models can be fitted by components using backfitting.
This is very similar to the more recent group coordinate descend algorithms.

We can fit any GAM with specified basis functions as one large single optimization problem, however for some parts like choosing penalization weights or for plots it might be useful to have a "marginal" model that just has one component and all other terms are in the offset.
This will be a mixture between backfitting/group coordinate descend and IRLS or standard optimization.

@josef-pkt
Copy link
Member Author

josef-pkt commented Jan 9, 2020

related issues:
#5689 GAM with backfitting in sandbox (This would now be simpler with constant removed from spline basis, but constant handling/removal would still be needed with kernel regression.)
#2710 sparse matrix support in models
I also have a prototype somewhere with partial linear model that absorbs or backfits linear part

elastic net fit_regularized uses coordinate descent in a "backfitting" loop

It would be good to get a prototype for the optimization part, i.e. the fit method, the surroundings would be as in a standard models

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant