You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We have a number of failures in the metropolitan_reingestion_workflow caused by AirflowTaskTimeouts during the pull_data step.
Per context in this comment, it's possible this is being caused by the entire DAG timing out, rather than the individual task. We should investigate to make sure.
Possible fixes:
Increasing the task timeout here, if indeed the pull_data step is timing out.
Description
We have a number of failures in the
metropolitan_reingestion_workflow
caused by AirflowTaskTimeouts during thepull_data
step.Per context in this comment, it's possible this is being caused by the entire DAG timing out, rather than the individual task. We should investigate to make sure.
Possible fixes:
pull_data
step is timing out.dagrun_timeout
of the entire DAG_list_length
fields in the (https://github.com/WordPress/openverse-catalog/blob/main/openverse_catalog/dags/providers/provider_reingestion_workflows.py#L80)The text was updated successfully, but these errors were encountered: