-
Notifications
You must be signed in to change notification settings - Fork 16.3k
Open
Labels
area:metricsarea:task-execution-interface-aip72AIP-72: Task Execution Interface (TEI) aka Task SDKAIP-72: Task Execution Interface (TEI) aka Task SDKarea:task-sdk
Milestone
Description
Find a way to emit metrics from the new supervisor process.
Some examples of what needs porting over:
airflow/airflow/jobs/local_task_job_runner.py
Line 224 in 84907f1
| Stats.incr("local_task_job_prolonged_heartbeat_failure", 1, 1) |
airflow/airflow/jobs/local_task_job_runner.py
Lines 347 to 361 in 84907f1
| def _log_return_code_metric(self, return_code: int): | |
| Stats.incr( | |
| "local_task_job.task_exit." | |
| f"{self.job.id}.{self.task_instance.dag_id}.{self.task_instance.task_id}.{return_code}" | |
| ) | |
| # Same metric with tagging | |
| Stats.incr( | |
| "local_task_job.task_exit", | |
| tags={ | |
| "job_id": self.job.id, | |
| "dag_id": self.task_instance.dag_id, | |
| "task_id": self.task_instance.task_id, | |
| "return_code": return_code, | |
| }, | |
| ) |
Metadata
Metadata
Assignees
Labels
area:metricsarea:task-execution-interface-aip72AIP-72: Task Execution Interface (TEI) aka Task SDKAIP-72: Task Execution Interface (TEI) aka Task SDKarea:task-sdk
Type
Projects
Status
Todo