Skip to content

MaxID logic for GCSToBigQueryOperator Causes XCom Serialization Error #26767

@patricker

Description

@patricker

Apache Airflow Provider(s)

google

Versions of Apache Airflow Providers

apache-airflow-providers-google 8.4.0rc1

Apache Airflow version

2.3.4

Operating System

OSX

Deployment

Virtualenv installation

Deployment details

No response

What happened

The Max ID parameter, when used, causes an XCom serialization failure when trying to retrieve the value back out of XCom

What you think should happen instead

Max ID value is returned from XCom call

How to reproduce

Set max_id_key=column, on the operator, check XCom of the operator after it runs.

Anything else

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions