Permalink
Fetching contributors…
Cannot retrieve contributors at this time
55 lines (40 sloc) 1.1 KB

Contributing

Components

Pull requests generally edit one of the following components at a time.

Compiler

  • Serializes tabular data to Apache Parquet
  • Transforms and parses files
  • builds packages locally
  • pushes packages to the registry
  • pulls packages from the registry

Technologies:

  • Python
  • pandas
  • PyArrow

Registry

  • Manages permissions
  • Stores package fragments in blob storage
  • Stores package meta-data
  • De-duplicates repeated data fragments

Technologies:

  • Python
  • Flask
  • SQLAlchemy
  • Postgres

Catalog

  • Displays package meta-data in HTML

Technologies:

  • JavaScript (ES6+)
  • node
  • React
  • Redux
  • Sagas

TODO

  • Add more detailed diagrams

Slack

Open Issues

License

Quilt is open source under the Apache License, Version 2.0..

Code of Conduct

Contributors must adhere to the Code of Conduct.