Skip to content

fox-world/stackoverflowGoSpider

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

21 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Golang Stackoverflow Spider

Using Golang to scrap data from Stackoverflow and store into MongoDB

Feature

  • Using goquery to crawl and parse data.
  • Using goroutine to crawl data in parallel.
  • Using sync to avoid duplicate crawl
  • Using MongoDB to store data.

Todo List

  • send mail to specified email everyday
  • Build chart to show the anlysis data
  • Build web pages to display and operate

License

The MIT License

About

Using Golang to crawl data from Stackoverflow

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages