GitHub - caijihui/py_spiders: spiders 爬虫。

Name		Name	Last commit message	Last commit date
Latest commit History 13 Commits
file		file
py_spiders		py_spiders
.gitignore		.gitignore
database.sql		database.sql
main.py		main.py
readme.md		readme.md
requirements.txt		requirements.txt
scrapy.cfg		scrapy.cfg
spider.log		spider.log

Repository files navigation

spider 爬虫

安装扩展
- pip3 install -r requirements.txt
初始化,安装scrapy
- pip3 install scrapy
创建爬虫
- scrapy genspider name domain

爬取微博热搜

    scrapy crawl weiboHot

爬取豆瓣电源top250

    scrapy crawl doubanTop250

About

spiders 爬虫。

Report repository

Releases

No releases published

Packages

No packages published

Languages

Python 100.0%