- set up virtualenv
- in the activated virtualenv, install airflow via "pip3 install apache-airflow[gcp,sentry,statsd]"
- install sklearn if needed via "pip3 install pyspark"
- Set AIRFLOW_HOME environment variable to the current working directory via ' export AIRFLOW_HOME="$(pwd)" ' DB: sqlite:////home/samuel/airflow/airflow.db
- navigate to airflow_learning/airflow. Then run the command "airflow db init". This creates the logs folder, a config file(airflow.cfg) and airflow.db
- If running for the first time, create a user. airflow users create --username admin --password root --firstname your_first_name --lastname your_last_name --role Admin --email your_email@domain.com
- verify username via "airflow users list"
- start airflow scheduler -- "airflow scheduler"
- open a new terminal, activate the virtualenv, navigate to airflow folder and start the webserver "airflow webserver"
- navigate to "localhost:8080"
ayodelephillips/airflow_learning
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
airflow training
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published