Airflow can be set up to send errors to Sentry.
First you must install sentry requirement:
pip install 'apache-airflow[sentry]'Add your SENTRY_DSN to your configuration file e.g. airflow.cfg under [sentry]. Its template resembles the following: '{PROTOCOL}://{PUBLIC_KEY}@{HOST}/{PROJECT_ID}'
[sentry]
sentry_dsn = http://foo@sentry.io/123Note
If this value is not provided, the SDK will try to read it from the SENTRY_DSN environment variable.
| Name | Description |
|---|---|
dag_id |
Dag name of the dag that failed |
task_id |
Task name of the task that failed |
execution_date |
Execution date when the task failed |
operator |
Operator name of the task that failed |
When a task fails with an error breadcrumbs will be added for the other tasks in the current dag run.
| Name | Description |
|---|---|
completed_tasks[task_id] |
Task ID of task that executed before failed task |
completed_tasks[state] |
Final state of task that executed before failed task (only Success and Failed states are captured) |
completed_tasks[operator] |
Task operator of task that executed before failed task |
completed_tasks[duration] |
Duration in seconds of task that executed before failed task |