Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

articles: title tokenization and searching #222

Open
tsbonev opened this issue Feb 14, 2019 · 0 comments
Open

articles: title tokenization and searching #222

tsbonev opened this issue Feb 14, 2019 · 0 comments
Assignees
@tsbonev
Labels
domain Make a domain decision feature Implement new feature
Projects
NHarker 0.2

Comments

@tsbonev
Copy link
Owner

tsbonev commented Feb 14, 2019

Nitrite's built-in stop-word based tokenization is not a good fit for the title field of an article, but the ability to FTS article titles is valuable nonetheless.
Consider having two fields, a normal text field for the title that can match exactly and a hidden(ish) tokenized field.
Look into whether Nitrite allows full matching on FTS fields (probably not if memory serves me right).
@tsbonev tsbonev added domain Make a domain decision feature Implement new feature labels Feb 14, 2019
@tsbonev tsbonev self-assigned this Feb 14, 2019
@tsbonev tsbonev added this to To Do in NHarker 0.2 via automation Feb 14, 2019
@tsbonev tsbonev changed the title nharker-core: article title tokenization articles: title tokenization and searching Feb 14, 2019
@tsbonev tsbonev mentioned this issue Feb 14, 2019
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@tsbonev tsbonev

Labels
domain Make a domain decision feature Implement new feature
Projects
NHarker 0.2
  
To Do
Milestone
No milestone
Development

No branches or pull requests
1 participant
@tsbonev