Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Read Redshift Spectrum metadata #124

Closed
redcatbear opened this issue Mar 27, 2019 · 0 comments · Fixed by #169
Closed

Read Redshift Spectrum metadata #124

redcatbear opened this issue Mar 27, 2019 · 0 comments · Fixed by #169
Assignees
@redcatbear
Labels
feature Product feature

Comments

@redcatbear
Copy link
Collaborator

Situation

Amazon's AWS Redshift Spectrum allows accessing tableau files located on S3 through Redshift. Unfortunately the projections that are called "external tables" in Redshift's terminology are not visible through the regular metadata as provided by the Redshift JDBC driver.

Currently it looks like we have to merge the regular table metadata obtained through the JDBC driver with information extracted from special tables that store the structure of the "external tables".

Acceptance Criteria

  1. The Redshift Virtual Schema sees the metadata for both regular tables and "external tables"
@redcatbear redcatbear self-assigned this Mar 27, 2019
@redcatbear redcatbear added the feature Product feature label Mar 27, 2019
redcatbear added a commit that referenced this issue Mar 28, 2019
@redcatbear
#124: Started rework on metadata reading.
a453c9c
redcatbear added a commit that referenced this issue Mar 28, 2019
@redcatbear
#124: Split of ColumnMetadataReader.
30ab0dc
redcatbear added a commit that referenced this issue Mar 28, 2019
@redcatbear
#124: Integrating with Dialects.
645573e
redcatbear added a commit that referenced this issue Apr 2, 2019
@redcatbear
#124: Covered ColumunMetadataReader by unit tests and refactored it.
89108ef
redcatbear added a commit that referenced this issue Apr 18, 2019
@redcatbear
#124: Added support for external tables. Added Redshift/Spectrum colu…
a709d96 
…mn mappings.
redcatbear added a commit that referenced this issue May 2, 2019
@redcatbear
Enhancement/131 refactor metadata reading (#153)
adbc826 
* #45: Rewrote parts of the JDBC adapter to use the new commons code.
* #121: Refactored request dispatching
* #124: Read Redshift metadata
* #131: Refactored general metadata reading
* #155: Moved validation logic to dialects
* #163: Fixed Hive integration tests
redcatbear added a commit that referenced this issue May 3, 2019
@redcatbear
#124: Added support for external tables. Added Redshift/Spectrum colu…
bfcc54e 
…mn mappings.

# Conflicts:
#	jdbc-adapter/virtualschema-jdbc-adapter/src/main/java/com/exasol/adapter/jdbc/AbstractMetadataReader.java
#	jdbc-adapter/virtualschema-jdbc-adapter/src/test/java/com/exasol/adapter/dialects/redshift/RedshiftColumnMetadataReaderTest.java
#	jdbc-adapter/virtualschema-jdbc-adapter/src/test/java/com/exasol/adapter/dialects/redshift/RedshiftMetadataReaderTest.java
#	jdbc-adapter/virtualschema-jdbc-adapter/src/test/java/com/exasol/adapter/jdbc/BaseRemoteMetadataReaderTest.java
@redcatbear redcatbear mentioned this issue May 3, 2019
Merged
redcatbear added a commit that referenced this issue May 3, 2019
@redcatbear
#124: Updated version number to 1.11.0
5e9f110
redcatbear added a commit that referenced this issue May 3, 2019
@redcatbear
#124: Improved test coverage.
8164552
redcatbear added a commit that referenced this issue May 3, 2019
@redcatbear
#124: Redshift Spectrum support (#169)
9c8cdb4 
* #124: Redshift Spectrum support
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@redcatbear redcatbear

Labels
feature Product feature
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

#124: Redshift Spectrum support exasol/virtual-schemas
1 participant
@redcatbear