Docker kafka confluent

An Avro SerDe implementation that integrates with the confluent schema registry and serializes and deserializes data according to the defined confluent wire format

ECE4721J (VE472) "Methods and Tools for Big Data" Coursework @UM-SJTU Joint Institute

A streaming platform which uses Avro for serialization and processes the incoming information of product, customer, orders through Kafka messagebrokers with Python Skilearn package for machine learning. Ultimate aim of this program is to provide a recommendation engine which also is able to integrate with log streaming to provide an end-end ente…

☀️ Avro, Protobuf, Thrift on Swagger

[Aiven] A Python micro-service that periodically health-checks a list of websites, optionally searching for a regex pattern in returned HTML, then sends the resulting health reports in Avro format to a Kafka topic

Client para publicação e consumo de eventos no kafka (produz json e avro)

Comparison of data serialization formats

Stream Bitcoin Price Training Data on Apache Kafka using Schema Registry as Avro Format Sink to BigQuery.

Upgrade from avro-tools and parquet-tools jars to a more user-friendly Python package.

Generate Apache Avro schemas for Pydantic data models.

CLI tool to generate HTML documentation for an Apache Avro schema

A python HTTP server that produces avro data to Kafka

CLI utility for backing up DynamoDB to Avro containers

Data Exploration on large datasets with Apache Beam

[WIP] Avro for Python in Rust

🧮 A Python Avro Schema Builder

[Aiven] A Python micro-service that periodically polls a Kafka topic for Avro messages, deserializes them into dataclass instances (website health-check reports), then persists the received health reports to a PostgreSQL instance

Low-effort benchmark of several serialization libraries for scientific applications