You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Rather than depending on processes running on Ingest, the crawls should be launched from Airflow. First, we'll just port the current mechanism over. (see #??? for planned improvements).
First use the bypm crawl launch as a test case, check it all works fine.
Check those crawls launched properly and down-stream tasks are working as expected.
Then add the npld crawl launch task, working in the same way.
The text was updated successfully, but these errors were encountered:
Rather than depending on processes running on Ingest, the crawls should be launched from Airflow. First, we'll just port the current mechanism over. (see #??? for planned improvements).
bypm
crawl launch as a test case, check it all works fine.npld
crawl launch task, working in the same way.The text was updated successfully, but these errors were encountered: