This simple crawler simply accesses Github APIs to get the information of all the repositories available in public on Github, then stores it in a local MySQL database.
It currently uses HttpClient, JSON-java, JDBC and JGit.
Developed by Haobin Ni and Yanpei Liu at Shanghai Jiao Tong University.