This is the installer for the Cloudflow toolkit.
This installer deploys all the backend components required to turn your Kubernetes cluster into a Cloudflow-compliant platform.
The Cloudflow installer deploys:
- The Cloudflow operator, which orchestrates the deployment of Cloudflow applications
- The Spark Operator
- The Strimzi Kafka Operator used to manage Apache Kafka clusters co-located or pre-existing
- The required service accounts with the minimal permissions needed by the supporting components
Additionally, this installer deploys:
- NFS - a supporting component that provides a shareable file system to enable storage for stateful applications
Currently, the provided installation scripts are validated for Google Kubernetes Engine (GKE) on the Google Cloud Platform. Testing on other major cloud providers is in the roadmap.
You need the command line tool for your particular Kubernetes cluster:
Note: Make sure you have the latest
To install Cloudflow on GKE it is a straightforward process:
# create a GKE cluster with name <cluster-name> $ ./create-cluster-gke.sh <cluster-name> # install Cloudflow in the GKE cluster $ ./install.sh <cluster-name> gke
<cluster-name> with the preferred name for your GKE cluster.
Similarly, to install Cloudflow on EKS follow this process:
# create an EKS cluster with name <cluster-name> $ ./create-cluster-eks.sh <cluster-name> <aws-region> # install Cloudflow in the EKS cluster $ ./install.sh <cluster-name> eks
<cluster-name> with the preferred name for your EKS cluster.
EFS integration with EKS
Some extra considerations are needed when integrating EFS with EKS. Please make sure the user launching the cluster satisfies the security groups requirements explained here.
In case of a failed installation, or if you simply want to uninstall entirely, run
create-cluster-<gke|eks>.shis optional. It creates a cluster on GKE/EKS that's large enough to launch several applications. You can also opt to create a cluster customized to your needs by either changing the values in the
create-cluster-gke.sh, using the Google Cloud Console, or the
gcloudCLI for GKE. Similarly, you can also opt to create a cluster customized to your needs by either changing the values in the
create-cluster-eks.sh, using the Amazon Web Services Console, or the
ekstlCLI for EKS.
cloudflownamespace The installer creates a namespace called
cloudflowwhere all supporting components are installed. This restriction will be removed in the future.