Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

sql: Full Text Search #7821

Open
Linicks opened this issue Jul 13, 2016 · 7 comments

Comments

@Linicks
Copy link
Contributor

commented Jul 13, 2016

All,
I'm sure most of you know about Bleve (https://github.com/blevesearch/bleve) a Go-lang based full-text indexer. I was wondering if you've considered integrating it with CockroachDB? I'ts seems like it may be a good fit, and is being used in other distributed databases.

  • It has an Apache licence.
  • Written in Go.
  • Already provides allot of value add functionality.

Thanks!
-- Nick

@petermattis

This comment has been minimized.

Copy link
Contributor

commented Jul 14, 2016

@Linicks Full-text search is something we'd like to support and Bleve is on my radar, though there are no concrete plans to integrate it.

@alexander-manley

This comment has been minimized.

Copy link

commented Jul 17, 2016

One approach for integrating Bleve with Cockroach, and thus provide CockroachDB with text search, would be to modify hugoidx (https://github.com/blevesearch/hugoidx) to allow it to BLEVE-index the contents of a Cockroach BLOB store (...#243) pre-populated with corpus text (web page scrapes, text-doc-dumps etc...).

In addition to hugoidx, the associated Go utility "bleve-hosted" could be wrapped into the embedded UI (https://github.com/cockroachdb/cockroach/tree/master/ui) in order to pull-out and/or highlight text search results pulled from the BLOB store and displayed as an additional panel under the left side "DATABASES" UI tab.

Bleve is based on file indexes, which by default are stored in BoltDB, so that part would need to be ported over to RocksDB for full integration. For the curious, a Bleve benchmark graph with RocksDB was posted to the Bleve Twitter stream a while back.

Reference:
http://www.blevesearch.com/news/Site-Search/
http://www.blevesearch.com/videos/

@knz knz changed the title Bleve - Full Text Search Integration? sql: Bleve - Full Text Search Integration? Jul 17, 2016

@knz knz added the C-enhancement label Jul 17, 2016

@knz knz added this to the Later milestone Jul 17, 2016

@petermattis

This comment has been minimized.

Copy link
Contributor

commented Jul 18, 2016

@alexander-manley Thanks for the notes. We'll definitely take a closer look at Bleve when considering full-text indexing.

@randyyaj

This comment has been minimized.

Copy link

commented May 11, 2017

Any updates on this?

@petermattis

This comment has been minimized.

Copy link
Contributor

commented May 15, 2017

@randyyaj Full-text indexing is something we'd like to do, but still a ways off and not currently scheduled.

@bdarnell bdarnell changed the title sql: Bleve - Full Text Search Integration? sql: Full Text Search Oct 20, 2017

@knz knz added this to Backlog in (DEPRECATED) SQL Front-end, Lang & Semantics via automation Apr 24, 2018

@knz knz moved this from Backlog to Feature requests / nice-to-have in (DEPRECATED) SQL Front-end, Lang & Semantics Apr 24, 2018

@SantoshSah

This comment has been minimized.

Copy link

commented Sep 8, 2018

@petermattis , any update?

@nstewart

This comment has been minimized.

Copy link
Contributor

commented Sep 8, 2018

Full text search is something we want to support, but it is not on the roadmap for cockroachdb 2.1 or 2.2. While we are adding some new functionality, for the next couple releases we are focusing on improving the performance and stability of our current offering before we add major new features.

@petermattis petermattis removed this from the Later milestone Oct 5, 2018

@jordanlewis jordanlewis added this to Triage in SQL Execution Team Apr 23, 2019

@jordanlewis jordanlewis moved this from Triage to Lower priority backlog in SQL Execution Team Apr 24, 2019

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.