Python Streaming DataFrames for Kafka
-
Updated
Mar 20, 2025 - Python
Python Streaming DataFrames for Kafka
Streaming IoT data into Confluent/Kafka using MQTT and EMQX | MQTT Kafka Integration
A real-time data cleaning pipeline for medical and healthcare data using Apache Spark, SparkNLP, Spark Streaming, and Kafka.
Facial Expression Recognition using Deep Learning. Keywords: Python, CNN, Image Classification, Keras, TensorFlow, Emotion Detection.
StreamGuard is a high-performance data management script using Kafka and MongoDB to efficiently handle and process real-time data streams. Ideal for scenarios like live GPS tracking, it features real-time data processing, reduced database load, and bulk data insertion.
Real-time financial data processing using Apache Kafka, Spark, MySQL, and Grafana, orchestrated with Docker. This pipeline fetches, processes, stores, and visualises stock data.
A Python-based graphical user interface (GUI) application for managing and visualizing cryptocurrency portfolios. This user-friendly application fetches real-time data from the CoinMarket API and provides an intuitive interface to track and analyze the value of your cryptocurrency assets.
Collecting highlights from the Quix community and social media in the form of interesting questions, comments, challenges, solutions and insights
This project offers a dual approach to understanding e-commerce customer behavior through: Batch data analysis and Real-time data processing.
A repository that contains implementation of a Real-Time Vehicle Data Processing Pipeline that efficiently manages and analyzes vehicle data through a cohesive system.
Deep learning-based lane detection system using convolutional neural networks (CNN) to detect lanes in road videos. The model processes video input, performs lane detection, and outputs a video with detected lane markings overlaid.
Bachelor thesis project of Michal Bureš made at BUT FIT.
Collecting highlights from the Quix community and social media in the form of interesting questions, comments, challenges, solutions and insights
A Python-based academic performance management app with a dynamic UI using Tkinter and ttkbootstrap. Features include secure SQLite storage, user authentication, real-time course info via SFU API, and Docker deployment for cross-platform compatibility.
A real-time data processing project for analyzing e-commerce sales data. It integrates Apache Kafka 📡 and Apache Spark ⚡ to extract brand information and calculate the top N brands. Results are stored in HBase and displayed in real-time ⏱️. This project enables seamless integration with visualization tools 📊, offering insights into brand trends.
The Data-Engineering-Project-Taxi-data involves analyzing and processing taxi data to extract valuable insights for business optimization. It includes building ETL pipelines, data modeling, and real-time analytics.
Add a description, image, and links to the real-time-data-processing topic page so that developers can more easily learn about it.
To associate your repository with the real-time-data-processing topic, visit your repo's landing page and select "manage topics."