This project implements an end-to-end techstack for a data platform, for local development.
-
Updated
Jul 10, 2024 - Python
This project implements an end-to-end techstack for a data platform, for local development.
How to implement a streaming at scale solution in Azure
AWS Lambda function/application invoking Airly API to get some basic information about current air quality
Apache Spark Connector for Azure Cosmos DB
This project aims to predict smartphone prices using a combination of batch and stream processing techniques in a Big Data environment. The architecture follows the Lambda Architecture pattern, providing both real-time and batch processing capabilities to users.
This project implemented a lambda architecture for analyzing domestic flight data in the US from 2009 to 2020. It used Apache Spark for batch processing, Spark Streaming for real-time analysis, and SVM models to predict flight cancellations and delays, with Docker for cluster management and Grafana for real-time visualization.
Build lambda architecture
Create data pipeline using Lambda architecture with Spark, Kafka, Airflow and Snowflake
A project which includes simulation of real time queries by kafka and performing stream and batch processing of the simulated queries by spark. Also, this follows lambda architecture, in which kafka is publisher and spark helps in subscribing
A full big data pipeline (Lambda Architecture) with Spark, Kafka, HDFS and Cassandra.
Basic logging mechanism for Node.js Lambda Functions and other AWS services, which produces logs in JSON format for easier reading through Cloudwatch Logs.
Repository containing codes written for the capstone project on Movie Recommendation Engine for University of Chicago's Big Data Application Architecture course (MPCS 53014), taught in Fall 2022 by Mike Spertus
Big Data Enterprise System, Kafka, Integration, Microservices
Serverless Typescript Template
Nuxt.js Serverless SSR using Cloudfront, Lambda@edge and S3
SupportStation: The People's Online Petition
Big data reference architecture and implementation for an online multiplayer game
Sentiment Classifier of Tweets, based on Lambda Architecture.
Full term Project of the exam of Parallel Computing of University of Florence. Implementation of Twitter Sentiment Analysis using Hadoop, Apache Storm and HBase to obtain parallelization.
Add a description, image, and links to the lambda-architecture topic page so that developers can more easily learn about it.
To associate your repository with the lambda-architecture topic, visit your repo's landing page and select "manage topics."