Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Any way to employ token filters? (as in TokenFilterStem) #32

Closed
nomoon opened this issue Jan 25, 2017 · 5 comments
Closed

Any way to employ token filters? (as in TokenFilterStem) #32

nomoon opened this issue Jan 25, 2017 · 5 comments

Comments

@nomoon
Copy link

nomoon commented Jan 25, 2017

The instructions provide for assigning a different Tokenizer and Normalizer, but don't say whether it is possible to use token filters, as explained @ http://groonga.org/docs/reference/token_filters.html

I notice in my indices, if I search for a plural word (e.g. "bananas"), I won't find any cases of the singular word (e.g. "banana"), though if I only search for singular words, I will find the plurals. I'd very much like to fix this.

@nomoon nomoon changed the title Any way to employ TokenFilterStem? Any way to employ token filters? (as in TokenFilterStem) Jan 25, 2017
@kou
Copy link
Member

kou commented Jan 25, 2017

We plan to support token filters but don't implement yet.

@kou kou closed this as completed in 104a432 Jan 25, 2017
@kou
Copy link
Member

kou commented Jan 25, 2017

I've implemented.

@nomoon
Copy link
Author

nomoon commented Jan 26, 2017

@kou Wow, that was very fast, thanks! I will attempt to test this soon. Being able to use a stemming filter would result in a large jump in accuracy for alphabetical language searches.

@nomoon
Copy link
Author

nomoon commented Jan 27, 2017

@kou I have tested this on OSX and it appears to work as expected (once groonga is also re-compiled from source to generate the stem filter). Thanks again!

@kou
Copy link
Member

kou commented Jan 27, 2017

Thanks for confirming this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants