Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add novel-value handing method to step_woe #64

Closed
kylegilde opened this issue Nov 12, 2020 · 4 comments
Closed

Add novel-value handing method to step_woe #64

kylegilde opened this issue Nov 12, 2020 · 4 comments

Comments

@kylegilde
Copy link

Hi

I noticed that all the glm based steps have a method for handling novel values: "For novel levels, a slightly timmed average of the coefficients is returned."

Would it make sense to add the same handling method to step_woe?

@topepo
Copy link
Member

topepo commented Nov 13, 2020

They are very different models. We can do that in the likelihood encoding and embedding steps because of their probabilistic models. WoE doesn't have the same properties.

@topepo topepo closed this as completed Nov 13, 2020
@kylegilde
Copy link
Author

kylegilde commented Nov 13, 2020

Hi Max,

I really want to use WoE transformation in my project, but I need it to be able to handle novel values or else my script will fail.

What if the user could specify novel values to be set to 0 like this other WoE encoder does?

http://contrib.scikit-learn.org/category_encoders/woe.html

Is there another way to handle novel values in a WoE transformation that I am overlooking?

Thanks

@topepo
Copy link
Member

topepo commented Nov 13, 2020

You can use step_novel() beforehand.

@github-actions
Copy link

github-actions bot commented Mar 6, 2021

This issue has been automatically locked. If you believe you have found a related problem, please file a new issue (with a reprex: https://reprex.tidyverse.org) and link to this issue.

@github-actions github-actions bot locked and limited conversation to collaborators Mar 6, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants