go-github-scraper

A Github Scraper and recommendation engine written in Go, to replace the previous version written in NodeJS (TypeScript).

Development

Create a .env that contains minimum the following environment variables:

GITHUB_TOKEN=<your_github_token>
DB_NAME=<mgo_db_name>
DB_HOST=<mgo_db_host>
DB_USER=<mgo_db_user>
DB_AUTH=<mgo_db_auth>
DB_PASS=<mgo_db_pass>

Start

$ make start

Build Docker Image

$ make docker

Tracing

Using opencensus to add jaeger tracing capabilities:

Additional metadata (key-value pairs) can be added for more information:

Stats

-------------------------------------------------------------------------------
 Language            Files        Lines         Code     Comments       Blanks
-------------------------------------------------------------------------------
 Dockerfile              1           56           29           11           16
 Go                     66         5788         4572          241          975
 Makefile                1           40           29            1           10
 Markdown                1           41           41            0            0
 YAML                    1           35           21           12            2
-------------------------------------------------------------------------------
 Total                  70         5960         4692          265         1003
-------------------------------------------------------------------------------