Query auto completer [LUCENE-625]

[asfimport]

A trie that helps users to type in their query. Made for AJAX, works great with ruby on rails common scripts <http://script.aculo.us/>. Similar to the Google labs suggester.

Trained by user queries. Optimizable. Uses an in memory corpus. Serializable.

---

Migrated from LUCENE-625 by Karl Wettin, 1 vote, updated Jan 26 2011
Attachments: autocomplete_0.0.1.tar.gz, autocomplete_20060730.tar.gz

[asfimport]

Karl Wettin (migrated from JIRA)

Beta 1.

Will add pervayler transactions in future.

[asfimport]

Karl Wettin (migrated from JIRA)

beta 2.

reqiures the Trie.java from beta1 tar-ball.

also features the first junit test case i ever wrote! :D

this is really simple code. but effective.

[asfimport]

Karl Wettin (migrated from JIRA)

(from a mail i just posted to java-user)

There is a memoryleak in the trie at optimize() that has been fixed locally. Might be available in #1701 too.

I'll repackage and post it up as soon I get time.

[asfimport]

Jason Rutherglen (migrated from JIRA)

Karl, did you ever proceed on this patch? I'm interested in adding autosuggest to Solr.

[asfimport]

Karl Wettin (migrated from JIRA)

Karl, did you ever proceed on this patch? I'm interested in adding autosuggest to Solr.

I used this patch for a few things a couple of years ago. If I recall everything right I ended up using the bootstrapped apriori corpus of #1701 as training data the last time. Made the corpus rather small, speedy and still relevant for most users.

But the major caveat is that this patch is a trie and is thus a "precise forward only" thing. So that might not fit all use cases. It might be easier to get things going using an index with ngrams of untokenized user queries (i.e. including whitespace) or subject-like fields.

But I really prefere user queries as using only the last n queries will make it sensitive to trends. That will however require quite a bit of data to work well. A lot as in hundreds of thousands of user queries, according to my experience.

Not sure if this was an answer to your question.. : )

[asfimport]

Shai Erera (@shaie) (migrated from JIRA)

What's the status of this? If we want to proceed, I suggest somehow using the recently added FST capabilities to impl the query-suggest feature.