PhotoDetails

Appplication is to

• Fetch data from https://jsonplaceholder.typicode.com/photos
• Process json data
• Create TSV file with columns "photo_id, title, url, timestamp"
• Gzip the TSV
• Upload file to S3 bucket

Configurable AWS Credentials and s3 Bucket

Add your ACCESS_KEY and SECRET_KEY in settings.py

ACCESS_KEY = ""
SECRET_KEY = ""

Change bucket name in settings.py

BUCKET_NAME = "photo-details-2021"

To Run

pip3.6 install virtualenv
virtualenv photo_details
source photo_details/bin/activate

pip3.6 install -r requirements.txt
python3.6 photo_details.py

Testing - To run pytest in docker

make test 

Output

Pytest and Test Coverage

Troubleshooting

• if make: *** [test] Error 1 Please set SECRET_KEY and ACCESS_KEY in settings.py.
• python version used is 3.6