Flyte is an open source, K8s-native extensible orchestration engine that manages the core machine learning pipelines at Lyft: ETAs, pricing, incentives, mapping, vision, and more.
Home: https://flyte.org
Docs: https://lyft.github.io/flyte
Slack: https://flyte-org.slack.com
Twitter: https://twitter.com/flyteorg
| Repo | Language | Purpose |
|---|---|---|
| flyte | RST | home, documentation, issues |
| flyteidl | Protobuf | interface definitions |
| flytepropeller | Go | execution engine |
| flyteadmin | Go | control plane |
| flytekit | Python | python SDK and tools |
| flyteconsole | Typescript | admin console |
| datacatalog | Go | manage input & output artifacts |
| flyteplugins | Go | flyte plugins |
| flytestdlib | Go | standard library |
| flytesnacks | Python | examples, tips, and tricks |
| Repo | Language | Purpose |
|---|---|---|
| Spark | Go | Apache Spark batch |
| Flink | Go | Apache Flink streaming |