安居客小区爬虫
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
LazyFW edit Feb 6, 2018
.gitignore edit Feb 6, 2018
Makefile 添加爬取我爱我家 Feb 5, 2018
README.md first commit Jan 17, 2018
config.ini update Feb 8, 2018
cookies-5i5j.txt 添加爬取我爱我家 Feb 5, 2018
cookies.txt first commit Jan 17, 2018
main.py 完善异常 Jan 17, 2018
price.py update Feb 8, 2018
requirements.txt first commit Jan 17, 2018
ve first commit Jan 17, 2018

README.md

安居客小区数据爬虫

Requirements:

  • python3
  • python3-venv
  • requests 2.18.4
  • pyquery 1.2.4
  • mysqlclient 1.3.12

Installation

cd Crawler
make install

Configuration

vim config.ini

Execution

cd Crawler
make

Files

├── LazyFW
│   ├── __init__.py
├── Makefile
├── README.md
├── config.ini              # 配置文件
├── cookies.txt             # 访问一下安居客,获取Cookies
├── main.py                 # 主程序
├── requirements.txt
└── ve