AIFlow is an open source framework that bridges big data and artificial intelligence. It manages the entire machine learning lifecycle as a unified workflow, including feature engineering, model training, model evaluation, model service, model inference, monitoring, etc.
In addition to the capability of orchestrating a group of batch jobs, by leveraging an event-based scheduler(enhanced version of Apache Airflow), AIFlow also supports workflows that contain streaming jobs. Such capability is quite useful for complicated real-time machine learning systems as well as other real-time workflows.
Learn more about AIFlow at https://ai-flow.readthedocs.io
- Define the machine learning workflows including batch/stream jobs.
- Manage metadata(generated by the machine learning workflow) of datasets, models, artifacts, metrics, jobs etc.
- Schedule and run the machine learning workflows from end to end.
- Publish and subscribe various events and take corresponding actions.
We happily welcome contributions to AIFlow in any ways, whether reporting problems, drafting features, or contributing code changes. You can report problems to request features in the GitHub Issues. If you want to contribute code changes, please check out the contributing documentation.
For more information, we recommend you to join the AIFlow Community Group on the Google Groups to contact us: aiflow@googlegroups.com.
You can also join the group on the DingTalk. The number of the DingTalk group is 35876083, which group can also be joined by scanning the QR code below:
