This FLINK project will consume from an azure event-hub and produce to a different event-hub ,and the code for deploying the same in kubernetes
#Getting Started with IDE
Steps for running in IDE like Intellij,
- Clone this repo.
- From Intellij, navigate File->New->Project-> Edit the EH name in FlinkTestConsumerProducer.java and broker name & connection string in consumer.config (if required) From the Maven tool window, perform the lifecycle - clean and compile. Run the main class . Clone the project flink-producer-ek and run the same. #Docker image Once you commit the code changes , an image will get generated in ACR. #Kubernetes Deployment Steps for running in Kubernetes(Manual steps), Login to your AKS cluster using any command line tools, eg: AzureCLI or AzureCloudShell. OR use minikube for local testing. Clone/Navigate to the project directory. CD Kubernetes Create the resources in the following order. a. kubectl create -f namespace.yaml b. kubectl create -f dockersecret.yaml c. kubectl create -f flink-configuration-configmap.yaml d. kubectl create -f jobmanager-service.yaml e. kubectl create -f jobmanager-deployment.yaml f. kubectl create -f taskmanager-deployment.yaml We could manage the above mentioned kubernetes resources and automate the deployment by using either one of the following ways in future 1.Helm Charts. 2.Kustomize. 3.Kubernetes Operator.