cmach_crawler_Farfetch

This crawler is for lab mission which crawling a luxury shopping website Farfetch

Learn some basic utilization of multiprocessing in python, need further exploration

Name		Name	Last commit message	Last commit date
Latest commit History 6 Commits
.idea		.idea
fashion		fashion
README.md		README.md
crawl.py		crawl.py
crawled_product.txt		crawled_product.txt
crawled_url.txt		crawled_url.txt
get_page_multiprocessing.py		get_page_multiprocessing.py
get_page_multiprocessing.pyc		get_page_multiprocessing.pyc
product.txt		product.txt
product_page_All In One.txt		product_page_All In One.txt
product_page_Beachwear.txt		product_page_Beachwear.txt
product_page_Coats.txt		product_page_Coats.txt
product_page_Denim.txt		product_page_Denim.txt
product_page_Dresses.txt		product_page_Dresses.txt
product_page_Jackets.txt		product_page_Jackets.txt
product_page_Knits.txt		product_page_Knits.txt
product_page_Lingerie & Hosiery.txt		product_page_Lingerie & Hosiery.txt
product_page_Shorts.txt		product_page_Shorts.txt
product_page_Skirts.txt		product_page_Skirts.txt
product_page_Suits.txt		product_page_Suits.txt
product_page_Tops.txt		product_page_Tops.txt
product_page_Trousers.txt		product_page_Trousers.txt

niranjanaryan/cmach_crawler_Farfetch