Build a dockerised data pipeline to extract Reddit messages via Reddit API, load these into Mongodb and transform them to conduct sentiment analysis with Python package VaderSentiment, and load these sentiments and messages in Postgres and send them to the desired channel via a Slack bot.
- Python 3.8 and above
- Docker
- Postgres
- pandas
- pymongo
- sqlalchemy
- vaderSentiment
- seaborn
- matplotlib
- slack_cleaner2
- In the terminal run the command
docker-compose buildto build images and containers - Run
docker-compose upto run the functionality in the code. - If the container and images need to be deleted, run
docker-compose down