In this project we put in place a Lambda architecture using Kafka, Spark Streaming (Batch processing), Spark Structured Streams (Stream processing) and Cassandra for Serving layer :
The NYPD wanted to set in place the best architecture that fit their security requirements as well as their budget. Our job was to make a POC of the Lambda Architecture