As work needed, I start to learn about building data pipeline and how to use apache airflow. I really love its design and how it works, so I decide to share my experience to who are going to learn airflow.
In this tutorial, I will cover things below:
- Introduction & definition
- Core concept (dag, operators ...)
- Basic operators
- Additional features (var, xcom, branch, hook, conn...)
- Tips & Tricks
- Dockerize
- More advanced features(may not cover)
Hope you can learn from it : )
*If you find this helpful, give me a star or share this to your colleagues/classmates.
Feel free to make a pull request if you find any mistake or better way to make the explanation more clear.
Contact me through email in english or chinese.