Please sign in to comment.
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
feat: Added schema compatibility check functionality (SchemaCompact.j…
…ava) (#339) * Protobuf and annotations working; first test that chekcs if user schema types are supported by BQ. * Halfway through basic type checking of nonsupported types; wrote tests on scalar types and oneof types * Almost finished detecting cycles in protos. * Finished checking for nonsupported types, added zetasql package as dependency in pom. * Reformatted to pass checkstyle. * Added all BQ compatibility checks and started working on main checking method * Removed all exact match code; realized parameter exact match is a backend object. * Added field mode checks * Refactored field option checking code. * All current tests work. * Finished BQInteger testing; need to add testing for all types and annotations. * Removing zetasql related code * Removed all zetasql related code * Finished basic type checking and added tests, need to add more in-depth tests to account for BQRecord * feat: Added SchemaCompact class that checks compatibility between proto schemas and BQ schemas. * Changed some files to make compilation/testing work * Added to clirr-ignored-differences to ignore differences in check method signature * Changed clirr ignored method to be the original method signature * Fixed code for pull request * Fixed linting errors * Fixed all PR suggestions * Merged isSupported and isCompatible, fixed minor issues according to PR suggestions. * Removed duplicate commits * Fix linting * Added a testcase for field name casing. * Added Integration tests, also added a field mode for footype in tableInfo as SchemaCheck does not allow BQ fields with no field mode. * Fixed linting * Fixed testing errors * Fixing test pt 2 * Reverted clirr-ignored-differences.ml
- Loading branch information
Showing with 1,674 additions and 49 deletions.
- +455 −17 ...cloud-bigquerystorage/src/main/java/com/google/cloud/bigquery/storage/v1alpha2/SchemaCompact.java
- +917 −32 ...d-bigquerystorage/src/test/java/com/google/cloud/bigquery/storage/v1alpha2/SchemaCompactTest.java
- +43 −0 .../src/test/java/com/google/cloud/bigquery/storage/v1alpha2/it/ITBigQueryWriteManualClientTest.java
- +259 −0 google-cloud-bigquerystorage/src/test/proto/schemaTest.proto
There are no files selected for viewing
Oops, something went wrong.