Skip to content
Kubernetes operator for managing the lifecycle of Apache Flink applications.
Go Shell Makefile Other
Branch: master
Clone or download
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
api/v1alpha1 Calculate Flink JVM heap size (#95) Nov 13, 2019
cloud_build Add Cloud Build CI (#46) Oct 10, 2019
config Calculate Flink JVM heap size (#95) Nov 13, 2019
controllers Calculate Flink JVM heap size (#95) Nov 13, 2019
deployments Add script to deploy Flink Operator to Kubernetes Jun 21, 2019
docs Calculate Flink JVM heap size (#95) Nov 13, 2019
hack Generate FlinkSessionCluster and FlinkJobCluster with Kubebuilder Jun 27, 2019
images/flink Improve the doc for GCS integration (#98) Nov 11, 2019
scripts Update check_build_deps.sh Oct 7, 2019
tests/kafka Add scripts for testing with Kafka (#97) Nov 11, 2019
.gitignore Use template file to generate image patch config instead of edit in p… Jul 24, 2019
CONTRIBUTING.md Add CONTRIBUTING.md Aug 21, 2019
Dockerfile Add builder image with dependencies installed (#44) Oct 10, 2019
Dockerfile.builder Add builder image with dependencies installed (#44) Oct 10, 2019
LICENSE Hello world version of the operator Jun 20, 2019
Makefile Minor refactor (#67) Oct 18, 2019
PROJECT Replace FlinkSessionCluster and FlinkJobCluster with FlinkCluster Jul 19, 2019
README.md Added custom docker image with GCS connector (#90) Nov 8, 2019
env.sh Add script to deploy Flink Operator to Kubernetes Jun 21, 2019
go.mod Support cancel job with savepoint (#82) Oct 31, 2019
go.sum Support cancel job with savepoint (#82) Oct 31, 2019
main.go Minor refactor (#67) Oct 18, 2019

README.md

Kubernetes Operator for Apache Flink

This is not an officially supported Google product.

Kubernetes Operator for Apache Flink is a control plane for running Apache Flink on Kubernetes.

Project Status

Alpha

The operator is under active development, backward compatibility of the APIs is not guaranteed for alpha releases.

Prerequisites

  • Version >= 1.9 of Kubernetes
  • Version >= 1.7 of Apache Flink

Overview

The Kubernetes Operator for Apache Flink extends the vocabulary (e.g., Pod, Service, etc) of the Kubernetes language with custom resource definition FlinkCluster and runs a controller Pod to keep watching the custom resources. Once a FlinkCluster custom resource is created and detected by the controller, the controller creates the underlying Kubernetes resources (e.g., JobManager Pod) based on the spec of the custom resource. With the operator installed in a cluster, users can then talk to the cluster through the Kubernetes API and Flink custom resources to manage their Flink clusters and jobs.

The operator supports creating both Flink job cluster and Flink session cluster through one custom resource FlinkCluster, depending on whether a job spec is provided. See samples: Flink job cluster, Flink session cluster.

Installation

The operator is still under active development, there is not Helm chart available yet, please follow the Developer Guide to build the operator and deploy it to your Kubernetes cluster.

Documentation

Contributing

Please check CONTRIBUTING.md and the Developer Guide out.

You can’t perform that action at this time.