Suggestion: custom stemmers #82
Labels
enhancement
New feature or request
Milestone
Comments
|
Thanks for the suggestion! Yeah, at the moment only Porter stemming is supported - the You raise an interesting point though; there are other stemming algorithms, not least so that words from languages other than English can be stemmed effectively. It's definitely something to think about... |
mikegoatly
added a commit
that referenced
this issue
Dec 29, 2023
mikegoatly
added a commit
that referenced
this issue
Dec 29, 2023
|
Custom stemming will be available in v6 |
mikegoatly
added a commit
that referenced
this issue
Jan 6, 2024
mikegoatly
added a commit
that referenced
this issue
Jan 16, 2024
Among other things... * Use latest C# version * Added support for bracketed field names #76 * Added field score boosting #72 (#83) * Added field score boosting #72 * Added score boosting query syntax #72 * Add .NET 8 as a target * Item score boosting (#95) * Allow characters to be escaped in query syntax #85 * Removing ImmutableCollections (#97) * Speed up field collection prior to scoring (#102) * Added support for adding custom stemmers #82 (#103) * Apply field filters while collecting results * Filter documents at navigator level #105 * Added query part weight calculations #105 Refactor query match collection primitives
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Judging by the code
this.stemmer = new PorterStemmer();it looks like implementing and passing my own stemmer is impossible.It should be trivial to make API changes allowing to assign custom stemmer in
TokenizationOptions. But maybe IStemmer would need more thoughts on the design.P.S.
this.stemmer = new PorterStemmer();is a nice illustration of new is glue :)The text was updated successfully, but these errors were encountered: