Scrapy the detail and lowest price of amazon best seller product by python spider
In developing........, welcome to join !
Some code has apply to pricejot.com. https://www.pricejot.com/
Sorry for that I dont update the spider for long time. Some feature maybe have some bug now and the document is not so completely. Anyway Iam back and will fix it in the month !
install python3.6 pip install -r requirements.txt
if you are contributer recommend to php install pipreqs run "pipreqs /path/to/project" if you add some packages in your code
- list page https://www.amazon.com/Best-Sellers/zgbs/ update every two hours.
- price detail page https://www.amazon.com/gp/offer-listing/B01FCTAEK4
- Scrapy the reviews by asin https://www.amazon.com/Libratone-ONE-Click-Caribbean-Green/product-reviews/B00ZU33BBC
- Scrapy the detail by asin pool(50%)
- Find the bad comment customer·s email and order id（considering to open source）
- Scrapy the category of level 1 from https://www.amazon.com/Best-Sellers/zgbs/ and store in mysql
- Scrapy the asin in the best seller asin from https://www.amazon.com/Best-Sellers/zgbs/ and store in mysql
- Scrapy the keywords rank by asin
- python https://bop.molun.net/
- scrapy https://docs.scrapy.org/en/latest/
Email：huangdingzhi@foxmail.com Wechat:dzdzhuang
Based on Python 3.6
The MIT License(http://opensource.org/licenses/MIT)
Please feel free to use and contribute to the development.
If you have any ideas or suggestions to improve Amazon-scrapy, welcome to submit an issue/pull request.
您的支持是我们坚持的最大动力。
| Backer | Fee |
|---|---|
| Jet.Zhang | ￥18.88 |
| Mike | ￥18.88 |
| 飞龙 | ￥5 |