Skip to content

Bigquery Warning messages cause Dataflow job to fail #20538

@damccorm

Description

@damccorm

I have a job fails when BigQuery throws any warning messages, even if the query is successful.

org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers.parseStatus Checks for "getErrors" and sets status to failure if there are any. However, this can include warning messages.

Google's Bigquery Client Code] states that 

"Errors here do not necessarily mean that the job has completed or was unsuccessful."

 

Imported from Jira BEAM-10999. Original Jira may contain additional context.
Reported by: acuitymd.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions