Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Metabase v0.34 does not display date, datetime fields from AWS Athena. #11607

Closed
kiansiong opened this issue Dec 30, 2019 · 6 comments
Closed
Assignees
Milestone

Comments

@kiansiong
Copy link

Describe the bug
All date and datetime fields are not being displayed. Underlying database is AWS Athena.
Data is retrieved from database correctly, evident by casting the date field to string using date_format(). However, any field with data type = date / datetime is not displayed / render on screen.

Logs
Please include javascript console and server logs around the time this bug occurred. For information about how to get these, consult our bug troubleshooting guide

To Reproduce
Select any fields with datatype = date / datetime, with database AWS Athena.

Expected behavior
Date / Datetime fields should be displayed.

Screenshots
image

Information about your Metabase Installation:

You can get this information by going to Admin -> Troubleshooting.
{
"browser-info": {
"language": "en-US",
"platform": "MacIntel",
"userAgent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36",
"vendor": "Google Inc."
},
"system-info": {
"java.runtime.name": "OpenJDK Runtime Environment",
"java.runtime.version": "1.8.0_111-internal-alpine-r0-b14",
"java.vendor": "Oracle Corporation",
"java.vendor.url": "http://java.oracle.com/",
"java.version": "1.8.0_111-internal",
"java.vm.name": "OpenJDK 64-Bit Server VM",
"java.vm.version": "25.111-b14",
"os.name": "Linux",
"os.version": "4.9.0-7-amd64",
"user.language": "en",
"user.timezone": "GMT"
},
"metabase-info": {
"databases": [
"athena"
],
"hosting-env": "unknown",
"application-database": "mysql",
"run-mode": "prod",
"version": {
"tag": "v0.34.0",
"date": "2019-12-19",
"branch": "release-0.34.x",

Severity
Severity High. This is affecting all datetime fields globally. Which limits any time series visualisations being displayed in Metabase.

Additional context
Add any other context about the problem here.

@flamber
Copy link
Contributor

flamber commented Dec 30, 2019

Hi @kiansiong

It seems like parts of the Diagnostic Info is missing, can you copy it again? Admin > Troubleshooting.
Which version of Athena driver?
Which version of Metabase were you using before, since it sounds like it used to work?

Have you considered creating an issue on https://github.com/dacort/metabase-athena-driver since the problem is specific to the driver, not general about Metabase?

Besides the very old Java version, I don't know, but there are very few details. So you don't see any warnings/errors in the log or browser console?

@kiansiong
Copy link
Author

hi @flamber , thanks for the quick response.

  1. Yes this used to work in a previous version. Here's a screenshot of a different environment, reverted back to the previous version, and the data is displaying correctly.
    image

  2. @Rohit-github-cldcvr are you able to advise on the metabase-athena-driver?

  3. Here is the entire diagnostic info.
    {
    "browser-info": {
    "language": "en-US",
    "platform": "MacIntel",
    "userAgent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36",
    "vendor": "Google Inc."
    },
    "system-info": {
    "java.runtime.name": "OpenJDK Runtime Environment",
    "java.runtime.version": "1.8.0_111-internal-alpine-r0-b14",
    "java.vendor": "Oracle Corporation",
    "java.vendor.url": "http://java.oracle.com/",
    "java.version": "1.8.0_111-internal",
    "java.vm.name": "OpenJDK 64-Bit Server VM",
    "java.vm.version": "25.111-b14",
    "os.name": "Linux",
    "os.version": "4.9.0-7-amd64",
    "user.language": "en",
    "user.timezone": "GMT"
    },
    "metabase-info": {
    "databases": [
    "mysql",
    "athena"
    ],
    "hosting-env": "unknown",
    "application-database": "mysql",
    "run-mode": "prod",
    "version": {
    "tag": "v0.34.0",
    "date": "2019-12-19",
    "branch": "release-0.34.x",
    "hash": "1335215"
    },
    "settings": {
    "report-timezone": "Asia/Kuala_Lumpur"
    }
    }
    }

@flamber
Copy link
Contributor

flamber commented Dec 30, 2019

Just for reference, looks like similar thing is happening with Oracle driver too:
https://discourse.metabase.com/t/format-date-to-month-has-missing-dimensions/8476
Very similar to #10285 too, which is MySQL specific, but I haven't been able to reproduce.

@mazameli mazameli added Priority:P1 Security holes w/o exploit, crashing, setup/upgrade, login, broken common features, correctness Querying/ Misc/Timezones and removed .Needs Triage labels Jan 2, 2020
@mazameli mazameli added this to the 0.34.1 milestone Jan 2, 2020
@dacort
Copy link
Contributor

dacort commented Jan 4, 2020

I'm tracking this bug over on dacort/metabase-athena-driver#27 - the tl;dr is that the Athena JDBC driver doesn't support some of the new java.time types. :(

@camsaul
Copy link
Member

camsaul commented Jan 6, 2020

This is an upstream issue with the 3rd-party Athena driver (needs to be updated) but it should be an easy fix, there's shared implementation code to work around drivers with no Java 8 support already in place. I added notes about how to use that in the issue linked above

@camsaul camsaul added bug with 3rd-party driver and removed Priority:P1 Security holes w/o exploit, crashing, setup/upgrade, login, broken common features, correctness Type:Bug Product defects labels Jan 10, 2020
@dacort dacort self-assigned this Jan 11, 2020
@dacort
Copy link
Contributor

dacort commented Jan 14, 2020

@dacort dacort closed this as completed Jan 14, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants