Amazon Athena support

[rgabo]

Amazon Athena (https://aws.amazon.com/athena/) is based on Hive/HiveQL/Presto and is provided by Amazon. It is essentially BigQuery in AWS land.

JDBC driver and HiveQL compatibility are provided out of the box. Presto provide low-latency, interactive querying and it is much better suited than the Hive support requested in #2157.

Fingers crossed and interested to see if there is any Athena adoption among Metabase users this early (Athena was announced a couple weeks ago at AWS re:Invent 2016).

⬇️ Please click the 👍 reaction instead of leaving a +1 or 👍or updates? comment

[cwbeck]

what are the thoughts on support for this?

[kdoh]

Hey @cwbeck. We generally prioritize support for databases based on community demand. Given the current number of upvotes for Athena, it's possible that might take a bit.

In the meantime, if you're feeling adventurous and have some experience with Clojure, you could try writing a driver yourself. @camsaul is our resident expert and can help with any questions you might have.

[cwbeck]

@kdoh I've not used Clojure. We currently use Scala. I don't suppose Clojure being on the JVM it could be written in Scala or Java and referenced in Clojure?

[salsakran]

@cwbeck we're pretty stringent on database driver style + testing, so it should be in clojure. Also note that unless you're committing to supporting the driver in scala/java indefinitely, we'll be on the hook for any future modifications + changing our build process.

[jeroenvandijk]

@kdoh Metabase looks promising so far and we, me and my collegeaus at AdGoji, want to start using it for Athena. We have some specific requirements, but for starters what we want is something generic. Even though we are a Clojure company, to save ourselves some time and to sponsor this project as well, we are thinking of outsourcing this integration work.

I'll send a message privately for a quote on this work. If others are interested in sharing the sponsoring please let me know.

[jckail]

Athena on Metabase would be great. I know other open source tools such as re:dash(python based), superset(python based), and piwik all support Athena if you did need something now. But to my understanding its just a specialized (hive/presto) JDBC driver provided by amazon.

[dragonsahead]

I would love to have this. Querying audit logs in S3 files would be awesome!

[dragonsahead]

I've been investigating about this: we can currently query S3 through "Redshift Spectrum", it's a very simple config that needs to be done in redshift so each time an external table is queried, redshift sends that query to Athena. I believe this is the simplest solution till now!

[julienba]

@paoliniluis
Interesting approach, can you give us some feedbacks about it ?