Skip to content

Ambari stack service for installing and managing Apache Airflow on HDP cluster

License

Notifications You must be signed in to change notification settings

miho120/ambari-airflow-mpack

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

41 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Apache Airflow management pack for Apache Ambari (airflow-ambari-mpack)

Mpack version License

Mpack allows you to install/configure airflow directly from ambari. Apache Airflow version included: 1.10.0

Installing Apache Aiflow Mpack:

  1. Stop Ambari server.
  2. Install the Apache Airflow Mpack on Ambari server.
  3. Start Ambari server.
ambari-server stop
ambari-server install-mpack --mpack=airflow-service-mpack.tar.gz
ambari-server start

Upgrading Apache Aiflow Mpack:

  1. Stop Ambari server.
  2. Upgrade the Apache Airflow Mpack on Ambari server.
  3. Start Ambari server.
ambari-server stop
ambari-server upgrade-mpack --mpack=airflow-service-mpack.tar.gz
ambari-server start

Installing Apache Airflow from Ambari:

  1. Action - Add service.
  2. Select Apache Airflow service.
  3. Choose destination server.
  4. You may configure Apache Airflow, change home folder.
  5. Deploy!

Add service Select Apache Airflow service Choose destination server Choose destination server configure Apache Airflow Deploy Deploy Deploy Deploy

Virtual environment support

If you want to run apache airflow in virtual environment, you should modify startup script "AIRFLOW_HOME/airflow_control.sh".

Example:

#!/bin/bash

export AIRFLOW_HOME=/usr/local/airflow/airflow/ && source /usr/local/airflow/airflow_venv/airflow/bin/activate && /usr/local/airflow/airflow_venv/airflow/bin/airflow $1 --pid /usr/local/airflow/airflow/airflow-sys-$1.pid

Enjoy!

About

Ambari stack service for installing and managing Apache Airflow on HDP cluster

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages