各种爬虫
Switch branches/tags
Nothing to show
Clone or download
Latest commit 7cd0784 Jun 24, 2018
Permalink
Failed to load latest commit information.
1688 1688 Oct 5, 2015
58.213.159.173 update Sep 19, 2016
JobGet update JobGet May 25, 2017
ali_comments fan-jian Oct 19, 2015
amap amap Sep 29, 2016
amazon update Jul 18, 2016
anjuke update anjuke Oct 3, 2017
apk.91.com 91 Dec 16, 2015
apps.fas.usda.gov update Aug 14, 2016
aso100.com update aso100 Dec 20, 2016
baidu.lecai.com zndz Oct 28, 2016
baidumap baidumap Aug 28, 2016
baijia.baidu.com update baijia.baidu.com May 5, 2018
bbs.tianya.cn tianya Aug 27, 2016
bitauto.com add bitauto.com Jun 13, 2018
bjguahao.gov.cn update bjguahao Dec 20, 2016
brokerbin.com add brokerbin Nov 16, 2016
buluo.qq.com add images Oct 31, 2016
centricparts.centriccatalog.com update centricparts.centriccatalog.com May 3, 2018
chart.cp.360.cn add charthistory Oct 23, 2016
china.tandfonline.com add tandfonline Nov 7, 2016
club.qingdaonews.com add qingdaonews Dec 20, 2016
cn.bing.com bing_search Sep 26, 2016
data.cma.gov.cn new Jul 22, 2016
datacenter.mep.gov.cn update Jul 22, 2016
dianping update searchshop.py for dianping May 18, 2017
dir.scmor.com add dir.scmor.com Jun 8, 2017
douban update Nov 3, 2016
downloadbooks savetobaiduyun Jul 3, 2016
duapp2.drexel.edu update Mar 17, 2016
ffip.cnca.cn update fip Jan 15, 2017
finance.sina.com.cn finance.sina.com Sep 22, 2016
finance.yahoo.com finance Oct 29, 2015
forecast.io forecast.py Apr 25, 2016
fsfc.fsjw.gov.cn house Sep 12, 2016
gcjs.linfen.gov.cn add gcjs.linfen.gov.cn Oct 8, 2016
gs.amac.org.cn update Apr 16, 2018
gzcdgl.gzii.gov.cn add 羊城充 Jan 18, 2017
hklock.com hklock Sep 9, 2016
iservice.10010.com update iservice Jun 11, 2018
itslaw itslaw Oct 5, 2015
jbk.39.net add 39 disease_list Nov 2, 2016
job.qiaosiwang.com new Mar 8, 2016
job Create REANME.md Oct 5, 2015
landchina update landchina Jun 11, 2018
lvyou.baidu.com new Mar 11, 2016
m.weike.fm add m.weike.fm Jan 14, 2018
mall.jd.com jd Jan 5, 2016
maoyan maoyan Apr 20, 2016
music.163.com 163 Nov 27, 2015
news.163.com add news.163.com Jun 2, 2017
news.sohu.com add sohu news Oct 19, 2016
news_get update news_get Dec 3, 2016
newseed.pedaily.cn add newseed Nov 20, 2016
pan.baidu.com add share link Oct 16, 2016
qimingpian.com new Apr 28, 2016
rank.kongzhong.com new Jun 25, 2016
rsc.p5w.net update rsc.p5w Feb 13, 2017
showmetheparts.com update asc Dec 26, 2016
shuju.wdzj.com update shuju.wdzj.com Mar 10, 2017
stock.finance.qq.com finance Aug 15, 2016
stock.jrj.com.cn flowhistory Aug 4, 2016
store.lining.com add store.lining.com Mar 22, 2018
store.nike.com update nike Apr 7, 2018
store.skechers.cn update Mar 27, 2018
sysjk.ivdc.org.cn update sysjk Jan 14, 2017
taobao add sycm Sep 6, 2016
targetjobs.co.uk add targetjobs.co.uk Nov 19, 2017
tianqi.2345.com update Jan 16, 2018
tmall.com add tmall.com Dec 24, 2017
travels add travels Jan 1, 2018
tur.bizdirlib.com bizdirlib Sep 21, 2016
v.qq.com movies spider May 12, 2018
waimai.meituan.com update orderlist Oct 7, 2016
was.zhuhai.gov.cn update Apr 2, 2018
weibo sina_weibo Aug 28, 2016
weidian new Feb 17, 2016
wenda.so.com wenda.so.com Sep 21, 2016
wenshu.court.gov.cn update Jan 14, 2018
wepiao.com update wepiao Jan 11, 2017
worldfreightrates trates Feb 23, 2016
www.189.cn add www.189.cn May 27, 2018
www.18ladys.com update 18ladys.py Sep 29, 2016
www.360che.com update 360che Nov 14, 2016
www.3j1688.com add 3j1688 Oct 1, 2016
www.51sole.com add www.51sole.com Apr 14, 2017
www.58.com add broker_info Nov 10, 2017
www.adidas.com.cn update adidas.py Mar 3, 2018
www.aihuishou.com aihuishou Oct 5, 2015
www.airbnb.com update Jul 1, 2016
www.aqistudy.cn update www.aqistudy.cn May 16, 2017
www.autozi.com products Dec 31, 2015
www.b8b8.tv ballbar Sep 15, 2016
www.baikemy.com update baikemy Oct 18, 2016
www.bilibili.com update Apr 3, 2017
www.cbooo.cn cbooo Apr 20, 2016
www.cbrc.gov.cn add www.cbrc.gov.cn May 1, 2017
www.chazidian.com add chazidian Oct 12, 2016
www.chealth.org.cn update chealth Oct 18, 2016
www.china-10.com china10 Jan 13, 2016
www.chinadegrees.cn update www.chinadegrees.cn Mar 29, 2018
www.chuanlaoda.cn chuanlaoda Feb 23, 2016
www.cjsyw.com ship Oct 26, 2015
www.cngold.org update Apr 30, 2018
www.cofeed.com add cofeed.py Oct 29, 2016
www.converse.com.cn update www.converse.com.cn Mar 3, 2018
www.cpbz.gov.cn update www.cpbz.gov.cn Feb 13, 2017
www.cqzk.com.cn update www.cqzk.com.cn Jan 15, 2018
www.ctrip.com add hotel comments spider May 10, 2018
www.dicos.com.cn dicos Jul 21, 2016
www.eastmoney.com add iguba Oct 18, 2016
www.echargenet.com update echargenet.py Jun 5, 2018
www.fang.com add new_house Oct 6, 2016
www.fjjs.gov.cn add www.fjjs.gov.cn Mar 29, 2018
www.fortunechina.com add www.fortunechina.com May 24, 2018
www.gamefaqs.com add gameinfor Oct 16, 2016
www.ganji.com anji Sep 12, 2016
www.gewara.com update Aug 7, 2016
www.globalsources.com update globalsources.py May 25, 2017
www.guahao.com doctor Jun 25, 2016
www.gzsun.org update Jan 5, 2018
www.hambleside-merchandise.co.uk add products_spider for www.hambleside-merchandise.co.uk Nov 12, 2017
www.hexun.com hexun Oct 7, 2015
www.hqew.com update www.hqew.com Feb 14, 2017
www.ifeng.com news May 19, 2016
www.imdb.com new Mar 17, 2016
www.itjuzi.com update Aug 10, 2016
www.iwencai.com update tushare_volume.py Apr 25, 2017
www.jfz.com new Feb 18, 2016
www.jiaonan.net add www.jiaonan.net Dec 24, 2017
www.jinyinmao.com.cn update www.jinyinmao.com.cn Jun 24, 2018
www.jisilu.com Jisilu Sep 20, 2016
www.kfc.com kfc; Jul 21, 2016
www.kimiss.com new Oct 27, 2015
www.lagou.com lagou Oct 13, 2016
www.lianjia.com add lianjia ershoufang Apr 4, 2018
www.liepin.com liepin Oct 10, 2015
www.locoso.com locoso Dec 16, 2015
www.mafengwo.cn add www.mafengwo.cn May 16, 2018
www.mcdonalds.com.cn add www.mcdonalds.com.cn Mar 21, 2017
www.mohurd.gov.cn update Jul 3, 2016
www.ncbi.nlm.nih.gov add ncbi.nlm.nih.gov Sep 7, 2016
www.pizzahut.com.cn udpate Jul 21, 2016
www.pm25.in pm25 Sep 5, 2016
www.ppdai.com update May 12, 2016
www.quikr.com update quikr Jan 21, 2017
www.renrendai.com renrendai Oct 7, 2015
www.ruyile.com add www.ruyile.com Apr 17, 2017
www.stats.gov.cn update Mar 1, 2018
www.std.gov.cn update Mar 24, 2018
www.sxhouse.com.cn sxhouse Aug 27, 2016
www.teld.cn update teld_app.py Jun 5, 2018
www.tianqihoubao.com add weather_history May 28, 2018
www.tichk.org add travel Oct 20, 2016
www.tjcn.org patent Nov 3, 2016
www.toutiao.com 爬取头条号信息 May 6, 2018
www.trademaps.cn update api Feb 2, 2018
www.tripadvisor.com new Apr 9, 2016
www.tyshbj.com.cn tyshbj Jul 22, 2016
www.ukers.cn update ukers Sep 17, 2016
www.umetrip.com update umetrip Feb 24, 2018
www.variflight.com update www.variflight.com Feb 18, 2017
www.vvic.com update Aug 9, 2016
www.watchseries.li new Jan 31, 2016
www.we.com update renrendai.py Mar 29, 2018
www.westfield.com.au update westfield Jan 30, 2017
www.wunderground.com add www.wunderground.com Feb 18, 2018
www.xmzfcg.gov.cn add xmzfcg_claim.py May 26, 2017
www.yelp.com update yelp Oct 20, 2016
www.ygdy8.com update Apr 25, 2018
www.yhd.com yhd Jan 5, 2016
www.yindou.com add yindou.py Feb 23, 2018
www.yougou.com update yougou May 7, 2018
www.youzy.cn add www.youzy.cn May 24, 2018
www.ywenterprise.com add product_spider for www.ywenterprise.com Nov 13, 2017
www.zdic.net update zdic Oct 29, 2016
www.zdobd.com add www.zdobd.com Jan 18, 2018
www.zhongchou.com update www.zhongzhou.com Apr 15, 2017
www.zimuzu.tv zimuzu Oct 5, 2015
www.zy91.com add zndz Oct 28, 2016
wwwapps.ups.com add write2excel Nov 18, 2016
wx.starcharge.com update starcharge Nov 5, 2017
wzzxbs.mofcom.gov.cn add wzzxbs.mofcom.gov.cn Apr 11, 2018
xxgk.jl.gov.cn inforget Aug 18, 2016
yangcong345.com yangcong345 Sep 27, 2016
z.jd.com update z.jd.zom Jun 1, 2017
zhidao.baidu.com zhidao.baidu.com Sep 19, 2016
zhihu zhihu Aug 28, 2016
zsb.suda.edu.cn new May 11, 2016
zt.zjzs.net add zt.zjzs.net Feb 13, 2018
Nyspider.py new Dec 9, 2015
README.md update readme May 8, 2017
util.py udpate util May 15, 2018

README.md

anjuke --- 安居客

aso100.com --- ASO100 APP榜单

baidu.lecai.com --- 百度彩票-时时彩历史数据

baidumap --- 百度地图商家信息

bbs.tianya.cn --- 天涯

data.cma.gov.cn --- 中国气象数据网

datacenter.mep.gov.cn --- 中华人民共和国环境保护部--数据中心

dianping --- 大众点评

finance.yahoo.com --- Yahoo Finance - Business Finance, Stock Market, Quotes, News

forecast.io --- Forecast

lvyou.baidu.com --- 桂林游记

maoyan --- 猫眼电影票房数据

music.163.com --- 网易云音乐-获取歌单

qimingpian.com --- 企名片 - 投资信息

stock.finance.qq.com --- A股股东信息

stock.jrj.com.cn --- 股票频道-金融界-股票资金流向

waimai.meituan.com --- 美团外卖

www.18ladys.com --- 中药大全_中草药大全

www.3j1688.com --- 三际手机采购网

www.aihuishou.com --- 爱回收

www.airbnb.com --- Vacation Rentals, Homes, Apartments & Rooms for Rent - Airbnb

www.autozi.com --- 中驰车福汽配商城-商品信息

www.b8b8.tv --- 比赛直播

www.baikemy.com --- 百科名医网

www.cbooo.cn --- 电影信息

www.chazidian.com --- 教材课文

www.ctrip.com --- 携程网游记

www.dicos.com.cn --- 德克士餐厅信息

www.eastmoney.com --- 东方财富网

www.fang.com --- 搜房网

www.gewara.com --- 格瓦拉电影评论

www.guahao.com --- 挂号网获取医院信息,医生信息

www.hexun.com --- 和讯网获取股票交易明细,买卖明细

www.ifeng.com --- 凤凰健康

www.imdb.com --- IMDb电影信息

www.itjuzi.com --- IT桔子投资信息

www.jisilu.com --- 集思录-实时投资数据

www.kfc.com --- KFC餐厅信息

www.lagou.com --- 拉勾网-最专业的互联网招聘平台_找工作_招聘_人才网_求职

www.lianjia.com --- 链家房产信息

www.liepin.com --- 猎聘网招聘信息

www.locoso.com --- 本地搜

www.mohurd.gov.cn --- 全国建筑市场监管与诚信信息发布平台

www.ncbi.nlm.nih.gov --- National Center for Biotechnology Information

www.pizzahut.com.cn --- 必胜客餐厅信息

www.pm25.in --- PM25.in空气质量指数(AQI)实时查询

www.ppdai.com --- 拍拍贷散标数据

www.renrendai.com --- 人人贷

www.tripadvisor.com --- TripAdvisor: Read Reviews, Compare Prices & Book

www.vvic.com --- 搜款网商品信息

www.variflight.com --- 飞常准

www.watchseries.li --- Watch Series Tv Shows Free | WatchSeries.ac

www.we.com --- 人人贷散标数据

www.yelp.com --- San Francisco Restaurants, Dentists, Bars, Beauty Salons, Doctors

www.yhd.com --- 1号店店铺信息

www.zdic.net --- 字典 zdic.net

www.zhongchou.com --- 众筹网

www.zy91.com --- 浙大一院智能导诊

zhihu --- 知乎

www.teld.cn --- 特来电充电桩信息

zhidao.baidu.com --- 百度知道

wenda.so.com --- 360问答

cn.bing.com --- 必应搜索

finance.sina.com.cn --- 新浪财经 上市公司高管信息

buluo.qq.com --- QQ部落帖子图片

www.360che.com --- 卡车之家车型数据

newseed.pedaily.cn --- 新芽融资数据

www.cpbz.gov.cn --- 企业标准信息公共服务平台 企业信息

bjguahao.gov.cn --- 北京市预约挂号统一平台 预约信息

wepiao.com --- 微票票房数据

www.toutiao.com --- 今日头条头条号文章数据

www.umetrip.com --- 航旅纵横航班信息