Consider adding a Weaviate Provider for Apache Airflow #29186
-
|
I started a branch possibly in vain because I love Weaviate's open source vector search capabilities and understand the benefits of DAGs for these types of workloads. I welcome a discussion about what it would take to get this done and if people would be open to such a request. As a slightly related aside, due to some accessibility compliance of a previous employer, I jumped in and made an extremely modest yet important contribution to Airflow. IOW, I've been here before but it's been years. My fork is still incubator. |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments
-
|
@MarcusSorealheis I would recommend discuss this first in devlist first. AFAIK there are quite a few requirements for create new community supported provider this include but not limited by include System Tests (see: AIP-47) However providers could maintained outside of community providers (in-house) and can be added as part of Airflow Ecosystem |
Beta Was this translation helpful? Give feedback.
-
|
Somebody at Astronomer agreed! https://docs.astronomer.io/learn/airflow-weaviate Congratulations and good work. |
Beta Was this translation helpful? Give feedback.
@MarcusSorealheis I would recommend discuss this first in devlist first. AFAIK there are quite a few requirements for create new community supported provider this include but not limited by include System Tests (see: AIP-47)
However providers could maintained outside of community providers (in-house) and can be added as part of Airflow Ecosystem