Add a Deltalake connector - #509
Conversation
|
Thanks so much for the contribution, it is off to a great start. I posted a few questions. |
Thanks @avirtuos for your feedback ! How can I have access to your questions ? It seems I can't see them in Github |
|
wazzup guys :D |
|
Hey @avirtuos I'm following along as well to see if this PR can be merged; it's listed on https://delta.io/integrations as a "preview" release but it would be great if this were an official part of awslabs/aws-athena-query-federation. |
|
@malonsocasas Nice job! |
|
Hello, is any one working on this topic? Because I am and I do not want to duplicate with someone ;) |
|
Hello, hello its me again, as this PR is stale I have created new one #825 which is an extension for that one :p cheers |
|
See: #825 (comment) |
Issue #310 :
Description of changes:
Add a first version of a Deltalake connector (https://github.com/delta-io/delta) so that Athena can interpret table schemas/partitions automatically (some current limitations are listed in the README).
Note that my first attempt was to use: https://github.com/delta-io/connectors. However, the library being in Scala and depending on a lot of packages, it makes it unsuitable for a Lambda code (with a limitation of 250 MB).
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.