抓取安居客,没登陆,芝麻代理,
pip list:
asn1crypto 0.24.0
attrs 18.1.0
Automat 0.6.0
certifi 2018.4.16
cffi 1.11.5
chardet 3.0.4
constantly 15.1.0
cryptography 2.2.2
cssselect 1.0.3
fake-useragent 0.1.10
hyperlink 18.0.0
idna 2.6
incremental 17.5.0
kafka-python 1.4.3
lxml 4.2.1
mysqlclient 1.3.12
parsel 1.4.0
Pillow 5.1.0
pip 10.0.1
pyasn1 0.4.3
pyasn1-modules 0.2.1
pycparser 2.18
PyDispatcher 2.0.5
pyOpenSSL 18.0.0
pypiwin32 223
pywin32 223
queuelib 1.5.0
redis 2.10.6
requests 2.19.1
Scrapy 1.5.0
service-identity 17.0.0
setuptools 39.2.0
six 1.11.0
Twisted 18.4.0
urllib3 1.23
w3lib 1.19.0
wheel 0.31.1
zope.interface 4.5.0
安装完后,直接main中启动即可,
可参考: https://blog.csdn.net/mingover/article/details/80951223