Skip to content

Rework StackdriverTaskHandler for the structlog era #65191#65198

Open
haseebmalik18 wants to merge 2 commits intoapache:mainfrom
haseebmalik18:stackdriver-structlog-rework
Open

Rework StackdriverTaskHandler for the structlog era #65191#65198
haseebmalik18 wants to merge 2 commits intoapache:mainfrom
haseebmalik18:stackdriver-structlog-rework

Conversation

@haseebmalik18
Copy link
Copy Markdown
Contributor

Add StackdriverRemoteLogIO with processors for real-time log streaming, upload(), and read() methods following the same pattern as CloudWatch, GCS, S3, HDFS, and other backends migrated in #48491.

Update airflow_local_settings.py to set REMOTE_TASK_LOG instead of patching DEFAULT_LOGGING_CONFIG handlers.

closes: #65191

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If possible this file should be extracted to a separated PR since core and providers don't have the same release cycle

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@amoghrajesh This sort of change (needing this in the provider for it to be functional) was exactly the sort of thing I wanted us to look at

Copy link
Copy Markdown
Member

@ashb ashb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please follow the pattern used for for the other Google logging provider -- make the *TaskHandler have a self.io property of the new Remote IO class and delegate things to it, rather than duplicating all the logic twice.

@haseebmalik18 haseebmalik18 force-pushed the stackdriver-structlog-rework branch from 5fdf14f to 4f52dbc Compare April 14, 2026 18:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

StackdriverTaskHandler rework for the structlog era

3 participants