Skip to content

Commit

Permalink
prepare release 0.18.0
Browse files Browse the repository at this point in the history
  • Loading branch information
davidrabinowitz committed Nov 12, 2020
1 parent 7e8dd70 commit 9c8afb6
Show file tree
Hide file tree
Showing 3 changed files with 22 additions and 8 deletions.
14 changes: 14 additions & 0 deletions CHANGES.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,19 @@
# Release Notes

## 0.18.0 - 2020-11-12
* Issue #226: Adding support for HOUR, MONTH, DAY TimePartitions
* Issue #260: Increasing connection timeout to the BigQuery service, and
configuring the request retry settings.
* Issue #263: Fixed `select *` error when ColumnarBatch is used (DataSource v2)
* Issue #266: Fixed the external configuration not working regression bug
(Introduced in version 0.17.2)
* PR #262: Filters on BigQuery DATE and TIMESTAMP now use the right type.
* BigQuery API has been upgraded to version 1.123.2
* BigQuery Storage API has been upgraded to version 1.6.0
* Guava has been upgraded to version 30.0-jre
* Netty has been upgraded to version 4.1.51.Final
* netty-tcnative has been upgraded to version 4.1.34.Final (Fixing issue #200)

## 0.17.3 - 2020-10-06
* PR #242, #243: Fixed Spark 3 compatibility, added Spark 3 acceptance test
* Issue #249: Fixing credentials creation from key
Expand Down
14 changes: 7 additions & 7 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -76,8 +76,8 @@ repository. It can be used using the `--packages` option or the

| Scala version | Connector Artifact |
| --- | --- |
| Scala 2.11 | `com.google.cloud.spark:spark-bigquery-with-dependencies_2.11:0.17.3` |
| Scala 2.12 | `com.google.cloud.spark:spark-bigquery-with-dependencies_2.12:0.17.3` |
| Scala 2.11 | `com.google.cloud.spark:spark-bigquery-with-dependencies_2.11:0.18.0` |
| Scala 2.12 | `com.google.cloud.spark:spark-bigquery-with-dependencies_2.12:0.18.0` |

## Hello World Example

Expand Down Expand Up @@ -595,7 +595,7 @@ using the following code:
```python
from pyspark.sql import SparkSession
spark = SparkSession.builder\
.config("spark.jars.packages", "com.google.cloud.spark:spark-bigquery-with-dependencies_2.11:0.17.3")\
.config("spark.jars.packages", "com.google.cloud.spark:spark-bigquery-with-dependencies_2.11:0.18.0")\
.getOrCreate()
df = spark.read.format("bigquery")\
.load("dataset.table")
Expand All @@ -604,15 +604,15 @@ df = spark.read.format("bigquery")\
**Scala:**
```python
val spark = SparkSession.builder
.config("spark.jars.packages", "com.google.cloud.spark:spark-bigquery-with-dependencies_2.11:0.17.3")
.config("spark.jars.packages", "com.google.cloud.spark:spark-bigquery-with-dependencies_2.11:0.18.0")
.getOrCreate()
val df = spark.read.format("bigquery")
.load("dataset.table")
```

In case Spark cluster is using Scala 2.12 (it's optional for Spark 2.4.x,
mandatory in 3.0.x), then the relevant package is
com.google.cloud.spark:spark-bigquery-with-dependencies_**2.12**:0.17.3. In
com.google.cloud.spark:spark-bigquery-with-dependencies_**2.12**:0.18.0. In
order to know which Scala version is used, please run the following code:

**Python:**
Expand All @@ -636,14 +636,14 @@ To include the connector in your project:
<dependency>
<groupId>com.google.cloud.spark</groupId>
<artifactId>spark-bigquery-with-dependencies_${scala.version}</artifactId>
<version>0.17.3</version>
<version>0.18.0</version>
</dependency>
```

### SBT

```sbt
libraryDependencies += "com.google.cloud.spark" %% "spark-bigquery-with-dependencies" % "0.17.3"
libraryDependencies += "com.google.cloud.spark" %% "spark-bigquery-with-dependencies" % "0.18.0"
```

## Building the Connector
Expand Down
2 changes: 1 addition & 1 deletion build.sbt
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ lazy val nettyTcnativeVersion = "2.0.34.Final"

lazy val commonSettings = Seq(
organization := "com.google.cloud.spark",
version := "0.17.4-SNAPSHOT",
version := "0.18.0",
scalaVersion := scala211Version,
crossScalaVersions := Seq(scala211Version, scala212Version)
)
Expand Down

0 comments on commit 9c8afb6

Please sign in to comment.