Skip to content

quota_project_id not exposed at operator level for Google Cloud operators #65591

@Ankurdeewan

Description

@Ankurdeewan

Description

Just noticed this while working on #56324quota_project_id was added to GoogleBaseHook but none of the Google Cloud operators expose it as a parameter. The only way to use it right now is through connection extras, which is connection-wide and can't be overridden per task. Every operator already does this pattern for impersonation_chain,quota_project_id just needs the same treatment.
I'm planning to implement this; starting with BigQuery operators and then GCS, Dataflow, and Dataproc.
Happy to submit a PR for this! just wanted to check if there's any reason this pattern shouldn't be extended to operators before I start.

Use case/motivation

if you have two BigQuery tasks in the same DAG that need to bill to different projects, there's currently no way to express that at the operator level. Organizations using shared service accounts across multiple billing projects hit this immediately.

Related issues

#56324

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions