wdcpop / Web-Crawler Public

Notifications You must be signed in to change notification settings
Fork 1
Star 4

A Web Crawler Template written in Python

4 stars 1 fork Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 26 Commits
.idea		.idea
bspider		bspider
configs		configs
crawler		crawler
crawler_announcement		crawler_announcement
data		data
lib		lib
newsweb		newsweb
.DS_Store		.DS_Store
README.md		README.md
requirements.txt		requirements.txt

Repository files navigation

Web Crawler Template

How To Run?

Go to the Main Directory
python crawlers/app.py NAME_OF_CRAWLER_FILE

About

A Web Crawler Template written in Python

Report repository

Releases

No releases published

Packages

Languages