Using Apache Airflow to schedule web scrapers
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
dags Initial Commit Oct 3, 2018
.gitignore Initial Commit Oct 3, 2018
LICENSE Initial commit Oct 3, 2018
README.md Readme updated Oct 3, 2018
airflow.cfg Initial Commit Oct 3, 2018
airflow.db Initial Commit Oct 3, 2018
unittests.cfg

README.md

Airflow Web Scraping

Learn how to implement Apache Airflow in your existing Web Scrapers. This repo is the part of the post Schedule web scrapers with Apache Airflow

Note

Do generate your own airflow configuration files by running airflow initdb instead of using mine.