Contributing

Components

Pull requests generally edit one of the following components at a time.

Compiler

Serializes tabular data to Apache Parquet
Transforms and parses files
builds packages locally
pushes packages to the registry
pulls packages from the registry

Technologies:

Python
pandas
PyArrow

Registry

Manages permissions
Stores package fragments in blob storage
Stores package meta-data
De-duplicates repeated data fragments

Technologies:

Python
Flask
SQLAlchemy
Postgres

Catalog

Displays package meta-data in HTML

Technologies:

JavaScript (ES6+)
node
React
Redux
Sagas

TODO

Add more detailed diagrams

Slack

Open Issues

License

Quilt is open source under the Apache License, Version 2.0..

Code of Conduct

Contributors must adhere to the Code of Conduct.