Locally Parallel Index Construction

Leveraging Go's concurrency features for efficient inverted index construction and interactive querying.

Usage

Simply get the package:

go get github.com/mleef/lpic

and then either make to build:

make

or install the binary directly:

go install github.com/mleef/lpic

Flags

Usage of lpic:
  -json
    	generate additional JSON formatted index file
  -raw-tf
    	use raw term frequency instead of log norm
  -num-results int
    	number of query results to show (default 5)
  -num-workers int
    	number of worker threads (default is number of cores on your machine)
  -out-dir string
    	destination directory of constructed index (default "./")
  -out-file string
    	file name of constructed index (default "index")
  -verbose
    	print verbose progress

Index Construction

lpic [optional flags] build [required target root directory to crawl]

Index Querying

lpic [optional flags] query [required generated .lpic index file]

License

MIT (see LICENSE file)