Skip to content

Releases: exasol/databricks-virtual-schema

1.0.2 Fixed vulnerabilities in test dependencies

Choose a tag to compare

@github-actions github-actions released this 31 Jul 12:52
9c56949

This release updates dependencies to fix CVE-2025-53864 and CVE-2025-48924 in transitive test dependencies
com.google.code.gson:gson:jar:2.10.1:test and org.apache.commons:commons-lang3:jar:3.17.0:test respectively.

We also added an exception for the OSSIndex for CVE-2024-55551, which is a false positive in Exasol's JDBC driver.
This issue has been fixed quite a while back now, but the OSSIndex unfortunately does not contain the fix version of 24.2.1 (2024-12-10) set.

Security

Dependency Updates

Test Dependency Updates

  • Updated com.databricks:databricks-jdbc:2.7.1 to 2.7.3
  • Updated com.databricks:databricks-sdk-java:0.42.0 to 0.56.0
  • Updated com.exasol:exasol-testcontainers:7.1.4 to 7.1.7
  • Updated com.exasol:hamcrest-resultset-matcher:1.7.0 to 1.7.1
  • Updated com.exasol:test-db-builder-java:3.6.0 to 3.6.2
  • Updated com.exasol:virtual-schema-shared-integration-tests:3.0.0 to 3.0.1
  • Added org.junit.jupiter:junit-jupiter-params:5.13.4
  • Removed org.junit.jupiter:junit-jupiter:5.11.2
  • Added org.slf4j:jcl-over-slf4j:2.0.17

Plugin Dependency Updates

  • Updated com.exasol:error-code-crawler-maven-plugin:2.0.3 to 2.0.4
  • Updated com.exasol:project-keeper-maven-plugin:5.0.0 to 5.2.3
  • Added io.github.git-commit-id:git-commit-id-maven-plugin:9.0.1
  • Removed io.github.zlika:reproducible-build-maven-plugin:0.17
  • Added org.apache.maven.plugins:maven-artifact-plugin:3.6.0
  • Updated org.apache.maven.plugins:maven-failsafe-plugin:3.5.2 to 3.5.3
  • Updated org.apache.maven.plugins:maven-surefire-plugin:3.5.2 to 3.5.3
  • Updated org.jacoco:jacoco-maven-plugin:0.8.12 to 0.8.13
  • Updated org.sonarsource.scanner.maven:sonar-maven-plugin:5.0.0.4389 to 5.1.0.4751

1.0.1 Fix CVE-2024-49194

Choose a tag to compare

@github-actions github-actions released this 14 Mar 14:59
aca264e

This release fixes CVE-2024-49194 by updating Databricks JDBC driver that was used in the integration tests.

Security

Dependency Updates

Test Dependency Updates

  • Updated com.databricks:databricks-jdbc:2.6.40-patch-1 to 2.7.1
  • Updated com.databricks:databricks-sdk-java:0.32.2 to 0.42.0
  • Updated com.exasol:exasol-testcontainers:7.1.1 to 7.1.4
  • Updated com.exasol:maven-project-version-getter:1.2.0 to 1.2.1
  • Removed commons-io:commons-io:2.17.0
  • Updated org.itsallcode:hamcrest-auto-matcher:0.8.1 to 0.8.2
  • Updated org.slf4j:slf4j-jdk14:2.0.16 to 2.0.17

Plugin Dependency Updates

  • Updated com.exasol:project-keeper-maven-plugin:4.3.3 to 5.0.0
  • Added com.exasol:quality-summarizer-maven-plugin:0.2.0
  • Updated io.github.zlika:reproducible-build-maven-plugin:0.16 to 0.17
  • Updated org.apache.maven.plugins:maven-clean-plugin:3.2.0 to 3.4.1
  • Updated org.apache.maven.plugins:maven-compiler-plugin:3.13.0 to 3.14.0
  • Updated org.apache.maven.plugins:maven-failsafe-plugin:3.2.5 to 3.5.2
  • Updated org.apache.maven.plugins:maven-install-plugin:3.1.2 to 3.1.4
  • Updated org.apache.maven.plugins:maven-site-plugin:3.12.1 to 3.21.0
  • Updated org.apache.maven.plugins:maven-surefire-plugin:3.2.5 to 3.5.2
  • Updated org.codehaus.mojo:flatten-maven-plugin:1.6.0 to 1.7.0
  • Updated org.codehaus.mojo:versions-maven-plugin:2.16.2 to 2.18.0
  • Updated org.sonarsource.scanner.maven:sonar-maven-plugin:4.0.0.4121 to 5.0.0.4389

1.0.0 First Public Release

Choose a tag to compare

@github-actions github-actions released this 09 Oct 10:57
63acb72

This is the first public release of the Databricks virtual schema. See the readme for known limitations.

Documentation

  • #44: Prepare release 1.0.0

Dependency Updates

Test Dependency Updates

  • Updated com.databricks:databricks-sdk-java:0.32.1 to 0.32.2
  • Updated org.junit-pioneer:junit-pioneer:2.2.0 to 2.3.0

0.3.0 Convert names to upper case, M2M auth

Choose a tag to compare

@github-actions github-actions released this 09 Oct 09:36
67f9f75

This release converts the names of Databricks tables and columns to upper case in Exasol to improve usability of the virtual schema. Quoting table and column names with double quotes " is no longer required as Exasol converts all names to upper case by default.

The release also implement OAuth M2M (machine-to-machine) authentication, see the user guide for details.

Security

Features

  • #18: Convert table and column names to upper case
  • #3: Implemented OAuth M2M authentication

Documentation

  • #32: Updated JDBC driver installation instructions in user guide

Dependency Updates

Test Dependency Updates

  • Updated com.databricks:databricks-sdk-java:0.32.0 to 0.32.1
  • Added commons-io:commons-io:2.17.0
  • Updated org.junit.jupiter:junit-jupiter:5.11.1 to 5.11.2

0.2.0 Map unsupported data types to VARCHAR

Choose a tag to compare

@github-actions github-actions released this 01 Oct 14:27
0f022b8

This release maps unsupported Databricks data types BINARY, ARRAY, MAP, STRUCT and VARIANT to Exasol type VARCHAR. Creating a virtual schema no longer fails when the source schema contains columns of these types. Please note that type BINARY is still not supported and creating a virtual schema with a BINARY column fails, see issue #34 for details.

The release also stores the original Databricks metadata for each table and column as JSON format in field databricks_metadata of the adapter notes for table and column. This helps with debugging the virtual schema.

Features

  • #15: Mapped unsupported data types to VARCHAR
  • #33: Store Databricks metadata in adapter notes

Dependency Updates

Test Dependency Updates

  • Updated com.databricks:databricks-sdk-java:0.31.1 to 0.32.0
  • Updated com.exasol:test-db-builder-java:3.5.4 to 3.6.0
  • Updated org.junit.jupiter:junit-jupiter:5.11.0 to 5.11.1

0.1.0 Initial implementation

Choose a tag to compare

@github-actions github-actions released this 23 Sep 08:32
86b3830

The Databricks Virtual Schema provides an abstraction layer that makes an external Databricks database accessible from an Exasol database through regular SQL commands. The contents of the external Databricks database are mapped to virtual tables which look like and can be queried as any regular Exasol table.

Important: This project is work in progress. Some features are not yet implemented. See known limitations for details.

Features

  • #11: Added query pushdown
  • #21: Added support for most important pushdown capabilities
  • #10: Added support for ALTER VIRTUAL SCHEMA <vs> REFRESH
  • #12: Added support for ALTER VIRTUAL SCHEMA <vs> SET ...

Refactoring

  • #16: Added shellcheck to CI build

Documentation

  • #22: Added user guide

Dependency Updates

Test Dependency Updates

  • Added com.databricks:databricks-jdbc:2.6.40-patch-1
  • Added com.databricks:databricks-sdk-java:0.31.1
  • Added com.exasol:exasol-testcontainers:7.1.1
  • Added com.exasol:hamcrest-resultset-matcher:1.7.0
  • Added com.exasol:maven-project-version-getter:1.2.0
  • Added com.exasol:test-db-builder-java:3.5.4
  • Added com.exasol:virtual-schema-shared-integration-tests:3.0.0
  • Added org.hamcrest:hamcrest:3.0
  • Added org.itsallcode:hamcrest-auto-matcher:0.8.1
  • Added org.junit-pioneer:junit-pioneer:2.2.0
  • Added org.junit.jupiter:junit-jupiter:5.11.0
  • Added org.slf4j:slf4j-jdk14:2.0.16

Plugin Dependency Updates

  • Added com.exasol:error-code-crawler-maven-plugin:2.0.3
  • Added com.exasol:project-keeper-maven-plugin:4.3.3
  • Added io.github.zlika:reproducible-build-maven-plugin:0.16
  • Added org.apache.maven.plugins:maven-clean-plugin:2.5
  • Added org.apache.maven.plugins:maven-compiler-plugin:3.13.0
  • Added org.apache.maven.plugins:maven-dependency-plugin:2.8
  • Added org.apache.maven.plugins:maven-deploy-plugin:2.7
  • Added org.apache.maven.plugins:maven-enforcer-plugin:3.5.0
  • Added org.apache.maven.plugins:maven-failsafe-plugin:3.2.5
  • Added org.apache.maven.plugins:maven-install-plugin:2.4
  • Added org.apache.maven.plugins:maven-jar-plugin:2.4
  • Added org.apache.maven.plugins:maven-resources-plugin:2.6
  • Added org.apache.maven.plugins:maven-site-plugin:3.3
  • Added org.apache.maven.plugins:maven-surefire-plugin:3.2.5
  • Added org.apache.maven.plugins:maven-toolchains-plugin:3.2.0
  • Added org.basepom.maven:duplicate-finder-maven-plugin:2.0.1
  • Added org.codehaus.mojo:exec-maven-plugin:3.4.1
  • Added org.codehaus.mojo:flatten-maven-plugin:1.6.0
  • Added org.codehaus.mojo:versions-maven-plugin:2.16.2
  • Added org.jacoco:jacoco-maven-plugin:0.8.12
  • Added org.sonarsource.scanner.maven:sonar-maven-plugin:4.0.0.4121
  • Added org.sonatype.ossindex.maven:ossindex-maven-plugin:3.2.0