Skip to content

SimilarityEncoder cleanup - #596

Merged
LilianBoulard merged 13 commits into
skrub-data:mainfrom
LeoGrin:remove_old_features_sim_enc
Jun 14, 2023
Merged

LilianBoulard merged 13 commits into
skrub-data:mainfrom
LeoGrin:remove_old_features_sim_enc

Conversation

@LeoGrin

@LeoGrin LeoGrin commented Jun 13, 2023

Copy link
Copy Markdown
Contributor

fix #573

@LeoGrin
LeoGrin changed the base branch from main to 0.2.X June 13, 2023 08:52
@LeoGrin
LeoGrin changed the base branch from 0.2.X to main June 13, 2023 08:52
@LeoGrin
LeoGrin force-pushed the remove_old_features_sim_enc branch from 9882a1d to 54bcf12 Compare June 13, 2023 09:02
@LilianBoulard

Copy link
Copy Markdown
Member

Thanks! Do you mind using this PR for some more cleanup of the SimilarityEncoder?
I'm thinking of is the similarity argument, which should be removed (along with the TODO).

@GaelVaroquaux

Copy link
Copy Markdown
Member

I would modify the "notes" section of the SimilarityEncoder as such

"The functionality of :class:SimilarityEncoder is easy to explain and understand, but it is not scalable. It is useful only to capture links across a few categories (eg eg: “west”, “north”, “north-west”), but not when there are many categories, as with open-ended entries.
Instead, the :class:~skrub.GapEncoder is usually recommended."

@GaelVaroquaux GaelVaroquaux left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Look's great to me. I've left a few comments, and in addition I agree that if you can tackle @LilianBoulard 's point its great.

Thanks!!

Comment thread skrub/_similarity_encoder.py Outdated
Comment thread skrub/_similarity_encoder.py Outdated
Comment thread skrub/_similarity_encoder.py Outdated
Comment thread skrub/tests/test_similarity_encoder.py Outdated
LeoGrin and others added 3 commits June 13, 2023 12:21
@LeoGrin

LeoGrin commented Jun 13, 2023

Copy link
Copy Markdown
Contributor Author

I'm thinking of is the similarity argument, which should be removed (along with the TODO).

I don't see any TODO @LilianBoulard.

@GaelVaroquaux GaelVaroquaux left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Two tiny suggestions. +1 to merge on my side once they have been addressed.

@LilianBoulard : I'll let you do a final review and press the merge button if everything is fine on your side.

Comment thread skrub/_similarity_encoder.py Outdated
Comment thread skrub/_similarity_encoder.py Outdated
@LeoGrin LeoGrin changed the title Remove "most_frequent" and "k-means" strategies from SimilarityEncoder SimilarityEncoder cleanup Jun 13, 2023
Co-authored-by: Gael Varoquaux <gael.varoquaux@normalesup.org>
@GaelVaroquaux

GaelVaroquaux commented Jun 13, 2023 via email

Copy link
Copy Markdown
Member

Comment thread CHANGES.rst Outdated
@LilianBoulard
LilianBoulard merged commit 746db33 into skrub-data:main Jun 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Remove "most_frequent" and "k-means" strategies from SimilarityEncoder

3 participants