Project for Go Search, a search engine for finding popular and relevant packages.
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
chrome-app ADD easybi Jan 14, 2016
configs Get crawl history from store service Apr 16, 2018
pipelines Get crawl history from store service Apr 16, 2018
scripts add stored.gs Apr 16, 2018
service Get crawl history from store service Apr 16, 2018
shared/proto Get crawl history from store service Apr 16, 2018
spider Move protos to shared/proto Apr 15, 2018
store Move protos to shared/proto Apr 15, 2018
tools Add more non go sub folder names. Refactoring of configs package usage. Oct 18, 2016
utils Fix some bugs, and do some refactoring Aug 22, 2016
.gitignore Change along with sophie change Mar 13, 2016
ACKNOWLEDGEMENTS Create ACKNOWLEDGEMENTS Oct 13, 2014
LICENSE Create LICENSE Oct 13, 2014
README.md Update README.md Jul 8, 2014
bi.go Fix setting of bi data path Jan 22, 2016
conf.json.template Get crawl history from store service Apr 16, 2018
crawler.bat made it so the bats will work with any GOPATH Jul 8, 2013
crawler.go Move protos to shared/proto Apr 15, 2018
crawler_test.go ignore vendor pakcages Apr 15, 2018
crawlerdb.go ignore vendor pakcages Apr 15, 2018
data.go Check name pattern before add sub folders as new candidates Mar 5, 2016
data_test.go ignore vendor pakcages Apr 15, 2018
db.go Use golangplus Aug 19, 2015
db_test.go Change test package Jul 2, 2015
gcse.go Fix some bugs, and do some refactoring Aug 22, 2016
index.go Fix some bugs, and do some refactoring Aug 22, 2016
index_test.go Change along with sophie change Mar 13, 2016
indexer.bat made it so the bats will work with any GOPATH Jul 8, 2013
license.txt Various minor update for spelling and links. Jul 8, 2013
ranking.go Fix bug of description not in index. Feb 11, 2016
ranking_test.go Change test package Jul 2, 2015
server.bat made it so the bats will work with any GOPATH Jul 8, 2013
text.go Use golangplus Aug 19, 2015
text_test.go Change test package Jul 2, 2015
tokenize_test.go Add counters for index age Jan 26, 2016
utils.go Fix some bugs, and do some refactoring Aug 22, 2016

README.md

Go Search GoSearch

A keyword search engine helping people to find popular and relevant Go packages.

Online service: Go Search

This is the root package with shared functions.

Sub packages are commands for running:

  • HTTP Server: Searching and web service
  • ToCrawl: Find packages to crawl.
  • Crawler: Crawling package files.
  • MergeDocs: Merge crawled package files with doc DB.
  • Indexer: Analyzing package information and generating indexed data for searching.

Development

You'll need to perform the following steps to get a basic server running:

  1. Create a basic conf.json file, limiting the crawler to a one minute run: { "crawler": { "due_per_run": "1m" } }
  2. Run the package finder: go run tocrawl/*.go
  3. Run the crawler: go run crawler/*.go
  4. Merge the crawled docs: go run mergedocs/*.go
  5. Run the indexer: go run indexer/*.go
  6. Run the server: go run server/*.go
  7. Visit http://localhost:8080 in your browser

LICENSE

BSD license.