Add Glue support

[matthewmturner]

Describe the feature

I would like an API for connecting to a Glue metastore.

Use Case

I am working on datafusion and we recently enabled querying data on s3 with aws-sdk-rust. As a next step we are looking to connect to a Glue Catalog as a metastore (more details here).

Proposed Solution

No response

Other Information

I didnt see Glue mentioned anywhere in any issues or on the Roadmap - so I presume it will be some time before it would be available but I wanted to get the request in anyway to gauge community interest and hopefully get it added to backlog.

Acknowledgements

• I may be able to implement this feature request
• This feature might incur a breaking change

A note for the community

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
• If you are interested in working on this issue, please leave a comment

[Velfi]

We do currently generate an SDK for Glue. Looking at the docs, it does seem to support most of what you need. However, (from a casual perusal) it doesn't seem like the Glue team has modeled a way to create "catalogs". It's not up to my team whether or not they'll implement that feature but I'd be happy to try and connect you with a PM on their team if you'd like to talk to them about it.

[matthewmturner]

@Velfi i apologize for missing that. we can look into the functionality and report back with our findings!

thanks for your quick response!

[Velfi]

No problem, we aim to please 😄

[rcoh]

closing this for now—feel free to re-open if you discover the Glue client doesn't do what you need :-)

[github-actions]

⚠️COMMENT VISIBILITY WARNING⚠️

Comments on closed issues are hard for our team to see.
If you need more assistance, please either tag a team member or open a new issue that references this one.
If you wish to keep having a conversation with other community members under this issue feel free to do so.