Kedro starters by GetInData

In GetInData we deploy Kedro-based projects to different environments (on-premise and cloud). This repository hosts the starters with a few deployment recipes, including the ones that use our plugins.

Available starters

• pyspark-iris-running-on-gke uses Google Kubernetes Engine to run Spark-powered kedro pipeline in a distributed manner.
• pyspark-iris-running-on-gcp-dataproc-serverless uses Google Cloud Dataproc Batches to run Spark-powered kedro pipeline in a distributed manner on Severless Spark.

Starters development

1. Clone the repository and switch to develop
2. Run poetry install
3. Run source $(poetry env info --path)/bin/activate Note: when you use conda, you need the extra step of conda deactivate to avoid conflict between the conda and venv
4. Install kedro pip install kedro==0.18.3
5. Run kedro new -s <name-of-the-starter>