Skip to content

Commit

Permalink
Merge pull request #5 from ewojtach/test-harness
Browse files Browse the repository at this point in the history
Test harness
  • Loading branch information
ewojtach committed Sep 8, 2022
2 parents a8bbda3 + f9bfd94 commit 67e6c8b
Show file tree
Hide file tree
Showing 102 changed files with 398 additions and 175 deletions.
Binary file removed .DS_Store
Binary file not shown.
19 changes: 19 additions & 0 deletions bigquery.sql
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
--liquibase formatted sql

--changeset myuser:create-a-table

create table liquibase_test_harness.dim_channels
(
dim_channel_key smallint,
channel_name STRING(40),
channel_type STRING(40) NOT NULL,
channel_sub_type STRING(40) NOT NULL,
storing_order integer NOT NULL,
channel_display_name STRING(40) NOT NULL,
channel_code STRING(40) NOT NULL,
created_date timestamp, ##Note that a TIMESTAMP itself does not have a time zone
last_modified_date timestamp,
oem_owner STRING(40) NOT NULL,
publisher STRING(40) NOT NULL
)
;
9 changes: 9 additions & 0 deletions bigquery.xml
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
<databaseChangeLog
xmlns="http://www.liquibase.org/xml/ns/dbchangelog/1.9"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://www.liquibase.org/xml/ns/dbchangelog/1.9
http://www.liquibase.org/xml/ns/dbchangelog/dbchangelog-1.9.xsd">

<include file="./bigquery.sql" relativeToChangelogFile="true" />

</databaseChangeLog>
Binary file modified lib/GoogleBigQueryJDBC42.jar
Binary file not shown.
Binary file not shown.
Binary file removed lib/animal-sniffer-annotations-1.20.jar
Binary file not shown.
Binary file removed lib/annotations-4.1.1.4.jar
Binary file not shown.
Binary file removed lib/api-common-1.10.3.jar
Binary file not shown.
Binary file removed lib/auto-value-annotations-1.8.1.jar
Binary file not shown.
Binary file removed lib/avro-1.10.2.jar
Binary file not shown.
Binary file removed lib/checker-compat-qual-2.5.5.jar
Binary file not shown.
Binary file removed lib/commons-codec-1.15.jar
Binary file not shown.
Binary file removed lib/commons-compress-1.20.jar
Binary file not shown.
Binary file removed lib/commons-logging-1.2.jar
Binary file not shown.
Binary file removed lib/conscrypt-openjdk-uber-2.5.1.jar
Binary file not shown.
Binary file removed lib/error_prone_annotations-2.6.0.jar
Binary file not shown.
Binary file removed lib/failureaccess-1.0.1.jar
Binary file not shown.
Binary file removed lib/gax-1.63.0.jar
Binary file not shown.
Binary file removed lib/gax-grpc-1.63.0.jar
Binary file not shown.
Binary file removed lib/gax-httpjson-0.80.0.jar
Binary file not shown.
Binary file removed lib/google-api-client-1.31.4.jar
Binary file not shown.
Binary file not shown.
Binary file removed lib/google-auth-library-credentials-0.25.5.jar
Binary file not shown.
Binary file removed lib/google-auth-library-oauth2-http-0.25.5.jar
Binary file not shown.
Binary file removed lib/google-cloud-bigquery-1.128.1.jar
Binary file not shown.
Binary file removed lib/google-cloud-bigquerystorage-1.20.2.jar
Binary file not shown.
Binary file removed lib/google-cloud-core-1.94.8.jar
Binary file not shown.
Binary file removed lib/google-cloud-core-http-1.94.8.jar
Binary file not shown.
Binary file removed lib/google-http-client-1.39.2.jar
Binary file not shown.
Binary file removed lib/google-http-client-apache-v2-1.39.2.jar
Binary file not shown.
Binary file removed lib/google-http-client-appengine-1.39.2.jar
Binary file not shown.
Binary file removed lib/google-http-client-gson-1.39.2.jar
Binary file not shown.
Binary file removed lib/google-http-client-jackson2-1.39.2.jar
Binary file not shown.
Binary file removed lib/google-oauth-client-1.31.5.jar
Binary file not shown.
Binary file removed lib/grpc-alts-1.37.0.jar
Binary file not shown.
Binary file removed lib/grpc-api-1.37.0.jar
Binary file not shown.
Binary file removed lib/grpc-auth-1.37.0.jar
Binary file not shown.
Binary file removed lib/grpc-context-1.37.0.jar
Binary file not shown.
Binary file removed lib/grpc-core-1.37.0.jar
Binary file not shown.
Binary file removed lib/grpc-google-cloud-bigquerystorage-v1-1.20.2.jar
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file removed lib/grpc-grpclb-1.37.0.jar
Binary file not shown.
Binary file removed lib/grpc-netty-shaded-1.37.0.jar
Binary file not shown.
Binary file removed lib/grpc-protobuf-1.37.0.jar
Binary file not shown.
Binary file removed lib/grpc-protobuf-lite-1.37.0.jar
Binary file not shown.
Binary file removed lib/grpc-stub-1.37.0.jar
Binary file not shown.
Binary file removed lib/gson-2.8.6.jar
Binary file not shown.
Binary file removed lib/guava-30.1.1-android.jar
Binary file not shown.
Binary file removed lib/httpclient-4.5.13.jar
Binary file not shown.
Binary file removed lib/httpcore-4.4.14.jar
Binary file not shown.
Binary file removed lib/j2objc-annotations-1.3.jar
Binary file not shown.
Binary file removed lib/jackson-annotations-2.12.2.jar
Binary file not shown.
Binary file removed lib/jackson-core-2.12.3.jar
Binary file not shown.
Binary file removed lib/jackson-databind-2.12.2.jar
Binary file not shown.
Binary file removed lib/javax.annotation-api-1.3.2.jar
Binary file not shown.
Binary file removed lib/joda-time-2.10.10.jar
Binary file not shown.
Binary file removed lib/json-20200518.jar
Binary file not shown.
Binary file removed lib/jsr305-3.0.2.jar
Binary file not shown.
Binary file not shown.
Binary file removed lib/opencensus-api-0.28.0.jar
Binary file not shown.
Binary file removed lib/opencensus-contrib-http-util-0.28.0.jar
Binary file not shown.
Binary file removed lib/perfmark-api-0.23.0.jar
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file removed lib/proto-google-common-protos-2.1.0.jar
Binary file not shown.
Binary file removed lib/proto-google-iam-v1-1.0.12.jar
Binary file not shown.
Binary file removed lib/protobuf-java-3.15.8.jar
Binary file not shown.
Binary file removed lib/protobuf-java-util-3.15.8.jar
Binary file not shown.
288 changes: 119 additions & 169 deletions lib/release-notes.txt
Original file line number Diff line number Diff line change
Expand Up @@ -3,56 +3,28 @@ Magnitude Simba Google BigQuery JDBC Data Connector Release Notes
==============================================================================

The release notes provide details of enhancements, features, known issues, and
workflow changes in Simba Google BigQuery JDBC Connector 1.2.19, as well as
workflow changes in Simba Google BigQuery JDBC Connector 1.2.22, as well as
the version history.


1.2.19 ========================================================================
1.2.22 =======================================================================

Released 2021-07-30
Released 2022-02-07

Enhancements & New Features

* [GBQJ-466][GBQJ-488][GBQJ-525][GBQJ-526][GBQJ-535] Third-party library
updates

* [GBQJ-438] Multi-statement transactions support

The connector now supports multi-statement transactions. For more
information, see:
https://cloud.google.com/bigquery/docs/reference/standard-sql/transactions

* [GBQJ-460] New MetaDataFetchThreadCount property

You can now control the number of threads used to call a DatabaseMetaData
method. To do this, set the MetaDataFetchThreadCount property to the
desired number of threads. For more information, see the Installation and
Configuration Guide.

* [GBQJ-460] Improved performance for metadata functions
The connector has been updated with the following third-party libraries:
- google-cloud-bigquerystorage 2.8.3 (previously 2.5.1)
- avro 1.11.0 (previously 1.10.2)
- commons-compress 1.21 (previously 1.20)

Improvements in parallelization and new design have been made to the
following metadata functions:
- getColumns
- getFunctions
- getFunctionColumns
- getProcedures
- getProcedureColumns
- getSchemas
- getTables

* [GBQJ-460] Data control language support
* [GBQJ-524] Internal connector improvements

The connector now supports data control language. For more
information, see:
https://cloud.google.com/bigquery/docs/reference/standard-sql/data-control-language

* [GBQJ-489] Third-party library update

The connector has been updated with the following third-party libraries:
- google-api-client 1.32.1 (previously 1.31.4)
- google-api-services-bigquery v2-rev20210617-1.32.1 (previously
v2-rev20210410-1.31.0)
- google-cloud-bigquery 1.137.0 (previously 1.128.1)
- google-cloud-bigquerystorage 1.23.0 (previously 1.20.2)

The connector has been updated with minor internal improvements.


Known Issues
The following are known issues that you may encounter due to limitations in
Expand Down Expand Up @@ -112,6 +84,14 @@ Workflow Changes =============================================================
The following changes may disrupt established workflows for the connector.


1.2.20 -----------------------------------------------------------------------

* [GBQJ-439] Updated Timeout property

The description of the Timeout property has been updated. For more
information, see the Installation and Configuration Guide.


1.2.14 -----------------------------------------------------------------------

* [GBQJ-435] MaxResults default value
Expand All @@ -133,6 +113,104 @@ The following changes may disrupt established workflows for the connector.

Version History ==============================================================

1.2.21 -----------------------------------------------------------------------

Released 2021-10-28

Enhancements & New Features

* [GBQJ-497] EnableSession support

You can now create a session ID from the first executed query on a
connection. To do this, set the EnableSession property to 1. For more
information, see the Installation and Configuration Guide.

* [GBQJ-516] UnsupportedHTAPIFallback support

You can now set the connector to fall back to the REST API when using
fetch workflows not supported on the High-Throughput API. To do this, set
the UnsupportedHTAPIFallback property to 1. For more information, see the
Installation and Configuration Guide.

* [GBQJ-496] INTERVAL data type support

The connector now has limited support for the INTERVAL data type. For more
information, see the Installation and Configuration Guide and the Google
BigQuery documentation:
https://cloud.google.com/bigquery/docs/reference/standard-sql/data-types#interval_type.

The INTERVAL data type cannot be retrieved through the High-Throughput API.
The default connector behavior is to fallback to the REST API for this
data. To disable this fallback, set the UnsupportedHTAPIFallback property
to 0.


1.2.20 -----------------------------------------------------------------------

Released 2021-09-30

Resolved Issues
The following issues have been resolved in Simba Google BigQuery JDBC
Connector 1.2.20.

* [GBQJ-497] When executing a script and DefaultLargeResultDataset or
DefaultLargeResultTable is configured, the connector terminates
unexpectedly.

* [GBQJ-503] When single-line comments contain DDL/DML commands using two
dashes ( -- ), the connector returns a null pointer exception.

* [GBQJ-507] When a query has more than 40 hyphens before the first
statement, the connector becomes unresponsive.


1.2.19 -----------------------------------------------------------------------

Released 2021-07-30

Enhancements & New Features

* [GBQJ-438] Multi-statement transactions support

The connector now supports multi-statement transactions. For more
information, see:
https://cloud.google.com/bigquery/docs/reference/standard-sql/transactions

* [GBQJ-460] New MetaDataFetchThreadCount property

You can now control the number of threads used to call a DatabaseMetaData
method. To do this, set the MetaDataFetchThreadCount property to the
desired number of threads. For more information, see the Installation and
Configuration Guide.

* [GBQJ-460] Improved performance for metadata functions

Improvements in parallelization and new design have been made to the
following metadata functions:
- getColumns
- getFunctions
- getFunctionColumns
- getProcedures
- getProcedureColumns
- getSchemas
- getTables

* [GBQJ-460] Data control language support

The connector now supports data control language. For more
information, see:
https://cloud.google.com/bigquery/docs/reference/standard-sql/data-control-language

* [GBQJ-489] Third-party library update

The connector has been updated with the following third-party libraries:
- google-api-client 1.32.1 (previously 1.31.4)
- google-api-services-bigquery v2-rev20210617-1.32.1 (previously
v2-rev20210410-1.31.0)
- google-cloud-bigquery 1.137.0 (previously 1.128.1)
- google-cloud-bigquerystorage 1.23.0 (previously 1.20.2)


1.2.18 -----------------------------------------------------------------------

Released 2021-06-30
Expand Down Expand Up @@ -416,132 +494,4 @@ BigQuery 1.2.8.
projects.


1.2.4 ------------------------------------------------------------------------

Released 2020-05-11

Enhancements & New Features

* [GBQJ-321] Support for BigQuery scripting

The driver now supports BigQuery scripting for Standard SQL. For more
information, see "Scripting in Standard SQL" in the BigQuery documentation:
https://cloud.google.com/bigquery/docs/reference/standard-sql/scripting

* [GBQJ-344] Support for additional passthrough query properties

You can now pass a property through to the server by using the
QueryProperties connection URL. For more information, see the
Installation and Configuration Guide.


Resolved Issues
The following issues have been resolved in Simba JDBC Driver for Google
BigQuery 1.2.4.

* [GBQJ-336] In some cases, complex queries cause the driver to terminate
unexpectedly.

* [GBQJ-354] In some cases, if you include comments between DDL statements,
the statement executes correctly but the driver generates an empty result
set.

* [GBQJ-357] If you use getProcedureColumns() to retrieve Array, Struct, or
Geography types, the driver terminates unexpectedly.

* [GBQJ-354] In some cases, if you include comments between DDL statements,
the statement executes correctly but the driver generates an empty result
set.

* [GBQJ-310] When using the Numeric data type, the REST API does not include
leading zeros.

This issue has been resolved. The driver now uses the default BigQuery
scale of 9 for Numeric data.

* [GBQJ-310] When using the Boolean or Datetime data types, there are
discrepancies between flat and nested columns.

This issue has been resolved. The format of Boolean and Datetime data in
nested columns now matches the format of flat columns.


1.2.3 ------------------------------------------------------------------------

Released 2020-03-27

Enhancements & New Features

* [GBQJ-325] Support for DDL ALTER TABLE SET OPTIONS statements.

The driver now supports ALTER TABLE SET OPTIONS statements in DDL. For
more information, see "ALTER TABLE SET OPTIONS" in the Google BigQuery
documentation:
https://cloud.google.com/bigquery/docs/reference/standard-sql/data-definition-language#alter_table_set_options_statement

* [GBQJ-302] Support for catalog metadata API calls for persistent functions.

The driver now supports catalog metadata API calls for persistent
functions.

* [GBQJ-324] Support for CREATE, CREATE OR REPLACE, DROP statements for
FUNCTION and PROCEDURE.

The driver now supports these statements.

* [GBQJ-327] Support for JDBC Batch Execute

The driver now supports JDBC Batch Execute.


Resolved Issues
The following issue has been resolved in Simba JDBC Driver for Google
BigQuery 1.2.3.

* [GBQJ-334] Temporary tables never expire

This issue has been resolved. Now, temporary tables expire after one hour
by default. You can change this expiration time by setting the new
LargeResultsDatasetExpirationTime connection property. For more
information, see the Installation and Configuration Guide.


1.2.2 ------------------------------------------------------------------------

Released 2019-09-23

Enhancements & New Features

* [GBQJ-303] Avro library update

The driver now uses Avro version 1.9.

As a result of this update, the driver no longer supports JDBC 4.1. For
more information, see "Workflow Changes" in this document.


Resolved Issues
The following issues have been resolved in Simba JDBC Driver for Google
BigQuery 1.2.2.

* [GBJQ-298] Some data types are returned differently in nested ARRAY and
STRUCT formats than they are in flat data.

This issue has been resolved. The following data types in nested ARRAY and
STRUCT formats are now returned differently to match the representation
that would be expected if they were in flat columns:
- BYTES
- DATE
- DATETIME
- NUMERIC
- TIME
- TIMESTAMP

Note: The Storage API returns NUMERIC data in a nested ARRAY or STRUCT
with trailing zeroes. The REST API trims the trailing zeroes.

* [GBQJ-309] The driver incorrectly rounds BigDecimal parameter values that
are bound to prepared statements.


==============================================================================
Binary file removed lib/slf4j-api-1.7.30.jar
Binary file not shown.
Binary file removed lib/threetenbp-1.5.1.jar
Binary file not shown.

0 comments on commit 67e6c8b

Please sign in to comment.