ASYNC IMAGE GATHERING

A Machine Learning exercise to grab images of kittens, written in Python.

Thoughts/Solution Process

First thought was to use beautiful soup, but I think Scrapy might be the better choice after initial research. Scrapy should already be asynchronous from what I've read.

Instructions

To activate venv

1. from cd cspace-async-py ✗ source spidervenv/bin/activate

To run spider

1. cd imagescrapy
2. scrapy crawl image_spider --logfile output.log

To run flask

1. cd ../
2. export FLASK_APP=display.py
3. flask run

Author Mark Ellis

References Used