Skip to content

Workspace for Airflow training, inlcuding docker and docker compose

Notifications You must be signed in to change notification settings

usarnume/airflow_workspace

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

22 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Codespaces Airflow training environment

This repository contains the code for the Airflow training environment.

Getting started

1) Create a new codespaces instance:

  • Click on the green button "code"
  • Select " ... " to prompt more options
  • Select "+ New with Options"

image


2) Configure your codespaces instance:

  • Select a 4-core machine
  • Click on "Create Codespace" image

3) Wait for the codespaces instance to be created:

4) Once the codespaces instance is created, you will be redirected to the VSCode codespaces environment.

This will be your workspace for the rest of this training

image


5) Check you have enough memory allocated to your codespaces instance:

  • In the terminal (ctrl + ` ) check you have more than 4GB of allocated memory:
docker run --rm "debian:bullseye-slim" bash -c 'numfmt --to iec $(echo $(($(getconf _PHYS_PAGES) * $(getconf PAGE_SIZE))))'

An no, 3.9 is not enough. If you see 3.9 means that you did not selected the right machine in step 2.


6) Run database migrations (ONLY RUN ONCE)

You need to run database migrations and create the first user account. It is all defined in the docker compose file so just run:

   docker compose up airflow-init

7) Now you can start all services:

    docker compose up

this will make Airflow available at: http://localhost:8080

8) Login to Airflow

image

About

Workspace for Airflow training, inlcuding docker and docker compose

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 86.1%
  • Dockerfile 13.9%