datafetcher

Project Code : Open Social Crawler

Instruction

데이터 포털/마켓, 블로그, 뉴스 등 웹 페이지의 내용 데이터를 끌어올 수 있는 모듈 A module that can bring up content data on web pages such as data portals/markets, blogs, and news.

Airflow 실행 - webserver/scheduler 실행

airflow webserver &
airflow scheduler &

Name		Name	Last commit message	Last commit date
Latest commit History 50 Commits
airflow/dags		airflow/dags
src		src
tests		tests
.gitignore		.gitignore
LICENSE.txt		LICENSE.txt
README.md		README.md
pyproject.toml		pyproject.toml
requirements.txt		requirements.txt
setup.py		setup.py