Skip to content

lisy09/ffa-2021-demos

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ffa-2021-demos

This repo summarizes several demos from Flink Forward Asia 2021.

demos

Prerequisite

  • The environemnt for build needs docker engine installed
  • have docker-compose installed
  • The environemnt for build needs GNU make > 3.8 installed
  • The environemnt for build needs bash shell
  • An available k8s cluster (e.g. k8s cluster in Docker Desktop), or using kind to setup local k8s cluster in docker containers
  • k8s related cli installed
    • kubectl
    • helm (>= 3.0)

Installing kind cli for using local k8s cluster with kind

On Linux:

curl -Lo ./kind "https://kind.sigs.k8s.io/dl/v0.11.1/kind-$(uname)-amd64"
chmod +x ./kind
mv ./kind /some-dir-in-your-PATH/kind

On macOS via Homebrew:

brew install kind

Create/Destroy local k8s cluster with kind

make local-k8s
make local-k8s-undeploy

Validating there is an available k8s cluster

kubectl get node

How to run aiflow demo

cd aiflow/flink-ai-flow

# build dockerimages
make docker-images

# setup dev cluster with docker-compose
make dev-deploy

# then docker login to dev container
docker exec -it flink-ai-flow-dev bash

# start server in container
start-all-aiflow-server

# run example
python examples/sklearn_examples/workflows/batch_train_stream_predict/batch_train_stream_predict.py

# check result on webui: localhost:8000 or airflow: localhost:8080
# check output under examples/sklearn_examples/workflows/batch_train_stream_predict/

# cleanup
make dev-undeploy

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published