Aggre-Gator

Our project aggregates articles from a few news sites and shows them in one place for the convenience of the user.

Amazon Lightsail Challenge by Agorize

Application Status - Current

We have presented our project on 30th March, 2022, during the Final Round of Amazon Lightsail Hackathon by Agorize, and are awaiting results. We are now working on more cool features for the project.

Application Status - 3rd round

We are presenting our submission for the 3rd round of the lightsail challenge. Currently, we are done with creation of backend services and working on integrating AWS services and developing frontend application as well as bug fixes.

Team members:

1. Anuj Koli
2. Anurag Shenoy
3. Aman Pathak
4. Ruchika Upadhyay
5. Naveen Kumar

Demo

Frontend

Backend

Articles saved in MongoDB and Elastic Search after scraping:

Run

Prerequisites

• Docker Compose

Start containers

Run the command:

sudo docker-compose -f docker-compose.yml up

to start all the containers.

Build & Run Containers

sudo docker-compose -f docker-compose.yml up --build

Containers

• frontend_flask: The Flask web application which will return html pages and act as the frontend for our project.
• web_aggregator: The main Flask web application which will return search results and feed.
• web_scraper: A Flask web application which will scrape websites for articles.
• celery_web_scraper: The Celery application which run the async tasks.
• es01: The primary node of the ElasticSearch cluster.
• rabbitmq: Broker for Celery workers and queues.
• mongo: MongoDB instance, primary data store, for storing articles and other user and app information.