Python Streaming DataFrames for Kafka

A real-time data cleaning pipeline for medical and healthcare data using Apache Spark, SparkNLP, Spark Streaming, and Kafka.

Streaming IoT data into Confluent/Kafka using MQTT and EMQX | MQTT Kafka Integration

Facial Expression Recognition using Deep Learning. Keywords: Python, CNN, Image Classification, Keras, TensorFlow, Emotion Detection.

StreamGuard is a high-performance data management script using Kafka and MongoDB to efficiently handle and process real-time data streams. Ideal for scenarios like live GPS tracking, it features real-time data processing, reduced database load, and bulk data insertion.

Real-time financial data processing using Apache Kafka, Spark, MySQL, and Grafana, orchestrated with Docker. This pipeline fetches, processes, stores, and visualises stock data.

Collecting highlights from the Quix community and social media in the form of interesting questions, comments, challenges, solutions and insights

A Python-based graphical user interface (GUI) application for managing and visualizing cryptocurrency portfolios. This user-friendly application fetches real-time data from the CoinMarket API and provides an intuitive interface to track and analyze the value of your cryptocurrency assets.

This project builds a real-time data pipeline that ingests, processes, and stores data using Apache Kafka, Apache Spark, and MySQL. It simulates streaming data, processes it in real time, and saves the results for analysis. Automated with Apache Airflow, it highlights expertise in data engineering and real-time data processing.

A repository that contains implementation of a Real-Time Vehicle Data Processing Pipeline that efficiently manages and analyzes vehicle data through a cohesive system.

This project offers a dual approach to understanding e-commerce customer behavior through: Batch data analysis and Real-time data processing.

Deep learning-based lane detection system using convolutional neural networks (CNN) to detect lanes in road videos. The model processes video input, performs lane detection, and outputs a video with detected lane markings overlaid.

The concept of Black Box is mainly heard by us in case of Aero-planes. Upon a catastrophe the Black Box is used to analyze the root cause of the issue. However, the purpose of Black Box can go beyond catastrophe analysis.

Bachelor thesis project of Michal Bureš made at BUT FIT.

Collecting highlights from the Quix community and social media in the form of interesting questions, comments, challenges, solutions and insights

A Python-based academic performance management app with a dynamic UI using Tkinter and ttkbootstrap. Features include secure SQLite storage, user authentication, real-time course info via SFU API, and Docker deployment for cross-platform compatibility.

The Data-Engineering-Project-Taxi-data involves analyzing and processing taxi data to extract valuable insights for business optimization. It includes building ETL pipelines, data modeling, and real-time analytics.

A real-time data processing project for analyzing e-commerce sales data. It integrates Apache Kafka 📡 and Apache Spark ⚡ to extract brand information and calculate the top N brands. Results are stored in HBase and displayed in real-time ⏱️. This project enables seamless integration with visualization tools 📊, offering insights into brand trends.