Docker를 사용하여 Hadoop 생태계의 구성 요소와 기타 필수 서비스를 컨테이너화하여 강력한 데이터 엔지니어링 환경을 설정하는 방법을 보여줍니다. 설정에는 Hadoop (HDFS, YARN), Apache Hive, PostgreSQL 및 Apache Airflow가 포함되며, 이들 모두가 원활하게 작동하도록 구성되어 있습니다.
-
Updated
May 29, 2024 - Shell
Docker를 사용하여 Hadoop 생태계의 구성 요소와 기타 필수 서비스를 컨테이너화하여 강력한 데이터 엔지니어링 환경을 설정하는 방법을 보여줍니다. 설정에는 Hadoop (HDFS, YARN), Apache Hive, PostgreSQL 및 Apache Airflow가 포함되며, 이들 모두가 원활하게 작동하도록 구성되어 있습니다.
Airflow Tutorial to learn practical implementation with basics Concepts, Architecture, Working & Configuration practises.
Quick Docker Compose deployment for Apache Airflow version 2.x. Ideal for local development
Modelt(mow·delt) is a modern data integration solution that connects data to data for advanced analytics.
Use Apache Airflow with Docker without the need for docker-compose
In this project we look to set up Airflow monitoring using ElasticSearch-LogStash-Kibana (ELK stack). We will set up the stack using docker images.
Ready to go Apache Airflow stack for docker
Airflow helm chart (KubernetesExecutor)
Docker for airflow with mysql as backend
Cloudformation templates for deploying Airflow in ECS
apache incubator airflow docker image
Docker Apache Airflow
Apache Airflow using Docker
Add a description, image, and links to the airflow-docker topic page so that developers can more easily learn about it.
To associate your repository with the airflow-docker topic, visit your repo's landing page and select "manage topics."