☀️ A tool for validating data using JSON Schema and converting JSON Schema documents into different data-interchange formats

Avrotize is a command-line tool for converting data structure definitions between different schema formats, using Apache Avro Schema as the integration schema model.

This library can convert a pydantic class to a avro schema or generate python code from a avro schema.

A pure python avro schema validator

☀️ Avro, Protobuf, Thrift on Swagger

A Python ORM for Avro Schemas

Async Python Rest Client to interact against Schema Registry confluent server

An automated and extensible space-efficiency benchmark of JSON-compatible serialization specifications

Package defining schema relevant to astronomy and astrophysics data, providing useful interfaces for interaction with those schema.

Visualize your raw data from .avro files for the EmbracePlus device from Empatica

Benchmarking avro libraries in Python 3

CLI tool to generate HTML documentation for an Apache Avro schema

The project showcases a data pipeline integrating Kafka messaging and MongoDB for efficient logistics data ingestion. It uses Python for Kafka producer/consumer operations and MongoDB for data storage.

🚢 Example of Apache Beam data pipeline

Kafka pubsub and spark streaming

Converts avro dml to abinitio specific dml

Avro Schema v1.8.2 (https://avro.apache.org/docs/1.8.2/spec.html) formatting with marshmallow - WIP

A data streaming project from a Udacity course that utilizes the Kafka ecosystem stacks and Faust to produce, transform, consume, and display data to a web page in real-time.

The project showcases a robust real-time data pipeline integrating Confluent Kafka, MySQL, and Avro serialization to facilitate seamless and immediate processing of e-commerce updates. The pipeline enables efficient streaming, transformation, and storage of incremental data updates for downstream analytics and business intelligence.

🧮 A Python Avro Schema Builder