Gender Art Project

Add some description here...

Configuration

$cp config.example.py  config.py
$vi config.py

Requirements

• python 3
• node > 7
• docker-compose or MongoDB

$pip install -r requirements.txt
$npm i

Instructions

First download the data as json files:

$python download_all_files.py

Make sure you have a mongo database running on http://localhost:27017 You can use docker for that:

$docker-compose up

Or alternatively MongoDB with these two steps:

$mongod --dbpath "your\path\to\db"
$mongo

Then insert the data into a mongodb:

$node dataToMongo-splitfiles.js

Scripts Descriptions

download_all_files.py

A script to connect to API and download the files with pagination. Caches files already downloaded. Set clear to 'True' to empty cache. Requires config.py with login information. Performs initial cleaning of json documents.

dataToMongo-splitfiles.js

Creates Mongo database with three collections: Author, Artwork and Media. Requires json data files.