Generate Apache Avro schemas for Python types including standard library data-classes and Pydantic data models.
-
Updated
May 27, 2024 - Python
Generate Apache Avro schemas for Python types including standard library data-classes and Pydantic data models.
Generate avro schemas from python classes. Code generation from avro schemas. Serialize/Deserialize python instances with avro schemas
Replicate data from MySQL, Postgres and MongoDB to ClickHouse
What's in your data? Extract schema, statistics and entities from datasets
Avrotize is a command-line tool for converting data structure definitions between different schema formats, using Apache Avro Schema as the integration schema model.
80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.
An automated and extensible space-efficiency benchmark of JSON-compatible serialization specifications
Simple datalake
ffmpeg for market data
Generate Apache Avro schemas for Pydantic data models.
Round-trip serialization/deserialization of any Python object to/from any serialization format including Avro and JSON.
The objective of this project is to build a flexible semi-Automated Data Pipeline using PySpark for KCC Analytics Department to provide a easiness of ETL ecosystem with scalable workloads, so they can solely focus on BI Reporting and valuable decision making.
Upgrade from avro-tools and parquet-tools jars to a more user-friendly Python package.
Utility generating avro files from postgres
CLI tool to generate HTML documentation for an Apache Avro schema
Convert AVRO events to JSON and perform schema validation using EventBridge Pipes and Confluent Schema Registry.
Add a description, image, and links to the avro topic page so that developers can more easily learn about it.
To associate your repository with the avro topic, visit your repo's landing page and select "manage topics."