In this project, you will execute an End-To-End Data Engineering Project on Real-Time Stock Market Data using Kafka. We are going to use different technologies such as Python, Amazon Web Services (AWS), Apache Kafka, Glue, Athena, and SQL.
Programming Language - Python Libraries - Pandas Amazon Web Service (AWS) AWS S3 (Simple Storage Service) AWS Athena AWS Glue Crawler AWS Glue Catalog AWS EC2 Apache Kafka
I used some random stock data from internet for this project. But you can use any real time stock API and connect to Kafka.