Skip to content

0.46.0

Choose a tag to compare

@dataproc-robot dataproc-robot released this 08 Oct 21:58
· 15 commits to master since this release
  • spark-4.2-bigquery is generally available! Like Spark 4.2, this connector requires at
    least Java 17 runtime.
  • ⚠️ Starting the next connector version, 0.47.0, the DataSource V1 connectors
    (a.k.a spark-bigquery-with-dependencies) will not be released as part of the regular
    connector release.
  • Issue #1520: Fixed ClassCastException when reading BigQuery DATETIME columns with
    readDataFormat=AVRO on Spark 3.4+.
  • Issue #1525: Fixed count() returning an incorrect value on DataSource
    V2 reads when the optimized empty projection path splits more than
    Integer.MAX_VALUE rows into a single partition. Thanks @AntinPhillips !
  • PR #1522: Reading a table that does not exist with the DataSource V2 connector now fails
    with Table <name> not found instead of an [INTERNAL_ERROR] NullPointerException,
    matching the DataSource V1 behavior.