Skip to content

a proxy address crawler which crawl xici.net.co based on scrapy

Notifications You must be signed in to change notification settings

DormyMo/ProxyCrawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ProxyCrawler

##a proxy address crawler which crawl xici.net.co based on scrapy

抓取西刺免费代理IP(www.xici.net.co)存入mongodb/json

#Run

###make sure you already installed scrapy

cd ProxyCrawler/ProxyCrawler/spiders/

scrapy crawl xici

About

a proxy address crawler which crawl xici.net.co based on scrapy

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages