Project for Go Search, a search engine for finding popular and relevant packages.
Go HTML CSS Protocol Buffer JavaScript Batchfile
Latest commit c6862e5 Oct 18, 2016 @daviddengcn fix typo
Permalink
Failed to load latest commit information.
chrome-app ADD easybi Jan 14, 2016
configs Add more non go sub folder names. Refactoring of configs package usage. Oct 18, 2016
pipelines fix typo Oct 18, 2016
proto Fix some bugs, and do some refactoring Aug 22, 2016
scripts Fix some bugs, and do some refactoring Aug 22, 2016
server replace Flash content by clipboard.js Sep 30, 2016
spider Add more non go sub folder names. Refactoring of configs package usage. Oct 18, 2016
store Fix some bugs, and do some refactoring Aug 22, 2016
tools Add more non go sub folder names. Refactoring of configs package usage. Oct 18, 2016
utils Fix some bugs, and do some refactoring Aug 22, 2016
.gitignore Change along with sophie change Mar 13, 2016
ACKNOWLEDGEMENTS Create ACKNOWLEDGEMENTS Oct 13, 2014
LICENSE Create LICENSE Oct 13, 2014
README.md Update README.md Jul 8, 2014
bi.go Fix setting of bi data path Jan 22, 2016
conf.json.template ADD easybi Jan 14, 2016
crawler.bat made it so the bats will work with any GOPATH Jul 8, 2013
crawler.go Fix some bugs, and do some refactoring Aug 22, 2016
crawler_test.go Check name pattern before add sub folders as new candidates Mar 5, 2016
crawlerdb.go Add found_way of github updates Mar 10, 2016
data.go Check name pattern before add sub folders as new candidates Mar 5, 2016
data_test.go Use bytesp.Slice Aug 13, 2015
db.go Use golangplus Aug 19, 2015
db_test.go Change test package Jul 2, 2015
gcse.go Fix some bugs, and do some refactoring Aug 22, 2016
index.go Fix some bugs, and do some refactoring Aug 22, 2016
index_test.go Change along with sophie change Mar 13, 2016
indexer.bat made it so the bats will work with any GOPATH Jul 8, 2013
license.txt Various minor update for spelling and links. Jul 8, 2013
ranking.go Fix bug of description not in index. Feb 11, 2016
ranking_test.go Change test package Jul 2, 2015
server.bat made it so the bats will work with any GOPATH Jul 8, 2013
text.go Use golangplus Aug 19, 2015
text_test.go Change test package Jul 2, 2015
tokenize_test.go Add counters for index age Jan 26, 2016
utils.go Fix some bugs, and do some refactoring Aug 22, 2016

README.md

Go Search GoSearch

A keyword search engine helping people to find popular and relevant Go packages.

Online service: Go Search

This is the root package with shared functions.

Sub packages are commands for running:

  • HTTP Server: Searching and web service
  • ToCrawl: Find packages to crawl.
  • Crawler: Crawling package files.
  • MergeDocs: Merge crawled package files with doc DB.
  • Indexer: Analyzing package information and generating indexed data for searching.

Development

You'll need to perform the following steps to get a basic server running:

  1. Create a basic conf.json file, limiting the crawler to a one minute run: { "crawler": { "due_per_run": "1m" } }
  2. Run the package finder: go run tocrawl/*.go
  3. Run the crawler: go run crawler/*.go
  4. Merge the crawled docs: go run mergedocs/*.go
  5. Run the indexer: go run indexer/*.go
  6. Run the server: go run server/*.go
  7. Visit http://localhost:8080 in your browser

LICENSE

BSD license.