In BigQueryStorageQuerySource, the results of a BigQuery query are written to a (named) temporary destination table rather than to an anonymous table since the BigQuery storage API can't currently read from all anonymous tables. When this API restriction is removed, then the BigQueryStorageQuerySource can start reading directly from anonymous result tables and most of the logic related to template compatibility and temporary dataset cleanup can be removed.
Imported from Jira BEAM-6931. Original Jira may contain additional context.
Reported by: kjung520.
In BigQueryStorageQuerySource, the results of a BigQuery query are written to a (named) temporary destination table rather than to an anonymous table since the BigQuery storage API can't currently read from all anonymous tables. When this API restriction is removed, then the BigQueryStorageQuerySource can start reading directly from anonymous result tables and most of the logic related to template compatibility and temporary dataset cleanup can be removed.
Imported from Jira BEAM-6931. Original Jira may contain additional context.
Reported by: kjung520.