Skip to content

Use the scrapy project crawling revenue data for each region, the result save to mysql

Notifications You must be signed in to change notification settings

wanyangcao/jobui

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 

Repository files navigation

jobui

爬取网站数据,结果写入mysql

目的:从网上获取不同地区不同职位的平均收入,目前我只爬了全国各地区的平均收入, 至于不同地区不同职位的平均工资今后再补充。

方法:主要用到scrapy框架,一个是因为使用比较方便,另外一个是结构清晰结果易于存储,我最终把结果 写入了mysql,具体细节可以参考scrapy文档:http://scrapy-chs.readthedocs.org/zh_CN/0.24/.

About

Use the scrapy project crawling revenue data for each region, the result save to mysql

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Languages