IoT SiteWise Grafana Plugin Giving "Metric request error"

[nenadilic84]

When adding multiple panels that use the IoT SiteWise Grafana Plugin as a data source, a query error appears after a dashboard refresh.

After manually going to the Query inspector and hiting Query->Referesh the panel info is displyed, but other panales in the same dashboard will then have the same issue "Metric request error".

Grafana Version: 7.4.0
AWS IoT SiteWise Datasource Version: 1.0.0

[bymattoa]

Are there any additional error details when hovering over the notification, or looking at the query inspector?

[nenadilic84]

yes, I get the 500 as a response of the query

[nenadilic84]

Logs for reference:

t=2021-02-15T19:26:43+0000 lvl=eror msg="Request Completed" logger=context userId=1 orgId=1 uname=admin method=POST path=/api/ds/query status=500 remote_a
ddr=11.121.123.123 time_ms=148 size=34 referer="https://xxx.xxx.com.tr/d/axVVVBPMk/xxx?orgId=1"
t=2021-02-15T19:26:43+0000 lvl=eror msg="Metric request error" logger=context userId=1 orgId=1 uname=admin error="rpc error: code = Unavailable desc = tra
nsport is closing" remote_addr=11.121.123.123
t=2021-02-15T19:26:43+0000 lvl=eror msg="Request Completed" logger=context userId=1 orgId=1 uname=admin method=POST path=/api/ds/query status=500 remote_a
ddr=11.121.123.123 time_ms=148 size=34 referer="https://xxx.xxx.com.tr/d/axVVVBPMk/xxx?orgId=1"
t=2021-02-15T19:26:43+0000 lvl=eror msg="Metric request error" logger=context userId=1 orgId=1 uname=admin error="rpc error: code = Unavailable desc = tra
nsport is closing" remote_addr=11.121.123.123
t=2021-02-15T19:26:43+0000 lvl=eror msg="Request Completed" logger=context userId=1 orgId=1 uname=admin method=POST path=/api/ds/query status=500 remote_a
ddr=11.121.123.123 time_ms=148 size=34 referer="https://xxx.xxx.com.tr/d/axVVVBPMk/xxx?orgId=1"
t=2021-02-15T19:26:43+0000 lvl=eror msg="Metric request error" logger=context userId=1 orgId=1 uname=admin error="rpc error: code = Unavailable desc = tra
nsport is closing" remote_addr=11.121.123.123
t=2021-02-15T19:26:43+0000 lvl=eror msg="Request Completed" logger=context userId=1 orgId=1 uname=admin method=POST path=/api/ds/query status=500 remote_a
ddr=11.121.123.123 time_ms=148 size=34 referer="https://xxx.xxx.com.tr/d/axVVVBPMk/xxx?orgId=1"
t=2021-02-15T19:26:43+0000 lvl=eror msg="Metric request error" logger=context userId=1 orgId=1 uname=admin error="rpc error: code = Unavailable desc = tra
nsport is closing" remote_addr=11.121.123.123
t=2021-02-15T19:26:43+0000 lvl=eror msg="Request Completed" logger=context userId=1 orgId=1 uname=admin method=POST path=/api/ds/query status=500 remote_a
ddr=11.121.123.123 time_ms=153 size=34 referer="https://xxx.xxx.com.tr/d/axVVVBPMk/xxx?orgId=1"
t=2021-02-15T19:26:43+0000 lvl=eror msg="Metric request error" logger=context userId=1 orgId=1 uname=admin error="rpc error: code = Unavailable desc = con
nection error: desc = \"transport: error while dialing: dial unix /tmp/plugin037062202: connect: connection refused\"" remote_addr=11.121.123.123
t=2021-02-15T19:26:43+0000 lvl=eror msg="Request Completed" logger=context userId=1 orgId=1 uname=admin method=POST path=/api/ds/query status=500 remote_a
ddr=11.121.123.123 time_ms=1 size=34 referer="https://xxx.xxx.com.tr/d/axVVVBPMk/xxx?orgId=1"
t=2021-02-15T19:26:43+0000 lvl=eror msg="Metric request error" logger=context userId=1 orgId=1 uname=admin error="rpc error: code = Unavailable desc = con
nection error: desc = \"transport: error while dialing: dial unix /tmp/plugin037062202: connect: connection refused\"" remote_addr=11.121.123.123
t=2021-02-15T19:26:43+0000 lvl=eror msg="Request Completed" logger=context userId=1 orgId=1 uname=admin method=POST path=/api/ds/query status=500 remote_a
ddr=11.121.123.123 time_ms=2 size=34 referer="https://xxx.xxx.com.tr/d/axVVVBPMk/xxx?orgId=1"
t=2021-02-15T19:26:43+0000 lvl=eror msg="Metric request error" logger=context userId=1 orgId=1 uname=admin error="rpc error: code = Unavailable desc = con
nection error: desc = \"transport: error while dialing: dial unix /tmp/plugin037062202: connect: connection refused\"" remote_addr=11.121.123.123
t=2021-02-15T19:26:43+0000 lvl=eror msg="Request Completed" logger=context userId=1 orgId=1 uname=admin method=POST path=/api/ds/query status=500 remote_a
ddr=11.121.123.123 time_ms=1 size=34 referer="https://xxx.xxx.com.tr/d/axVVVBPMk/xxx?orgId=1"
t=2021-02-15T19:26:43+0000 lvl=eror msg="Metric request error" logger=context userId=1 orgId=1 uname=admin error="rpc error: code = Unavailable desc = con
nection error: desc = \"transport: error while dialing: dial unix /tmp/plugin037062202: connect: connection refused\"" remote_addr=11.121.123.123
t=2021-02-15T19:26:43+0000 lvl=eror msg="Request Completed" logger=context userId=1 orgId=1 uname=admin method=POST path=/api/ds/query status=500 remote_a
ddr=11.121.123.123 time_ms=0 size=34 referer="https://xxx.xxx.com.tr/d/axVVVBPMk/xxx?orgId=1"
t=2021-02-15T19:26:43+0000 lvl=eror msg="Metric request error" logger=context userId=1 orgId=1 uname=admin error="rpc error: code = Unavailable desc = con
nection error: desc = \"transport: error while dialing: dial unix /tmp/plugin037062202: connect: connection refused\"" remote_addr=11.121.123.123
t=2021-02-15T19:26:43+0000 lvl=eror msg="Request Completed" logger=context userId=1 orgId=1 uname=admin method=POST path=/api/ds/query status=500 remote_a
ddr=11.121.123.123 time_ms=1 size=34 referer="https://xxx.xxx.com.tr/d/axVVVBPMk/xxx?orgId=1"
t=2021-02-15T19:26:43+0000 lvl=eror msg="Metric request error" logger=context userId=1 orgId=1 uname=admin error="rpc error: code = Unavailable desc = con
nection error: desc = \"transport: error while dialing: dial unix /tmp/plugin037062202: connect: connection refused\"" remote_addr=11.121.123.123
t=2021-02-15T19:26:43+0000 lvl=eror msg="Request Completed" logger=context userId=1 orgId=1 uname=admin method=POST path=/api/ds/query status=500 remote_a
ddr=11.121.123.123 time_ms=2 size=34 referer="https://xxx.xxx.com.tr/d/axVVVBPMk/xxx?orgId=1"
t=2021-02-15T19:26:43+0000 lvl=info msg=Profiler logger=plugins.backend pluginId=grafana-iot-sitewise-datasource enabled=false
t=2021-02-15T19:26:58+0000 lvl=info msg="Request Completed" logger=context userId=0 orgId=0 uname= method=GET path=/ status=302 remote_addr=10.192.11.152 
time_ms=0 size=29 referer=
t=2021-02-15T19:27:00+0000 lvl=info msg="Request Completed" logger=context userId=0 orgId=0 uname= method=GET path=/ status=302 remote_addr=10.192.10.30 t
ime_ms=0 size=29 referer=
t=2021-02-15T19:27:11+0000 lvl=eror msg="Metric request error" logger=context userId=1 orgId=1 uname=admin error="rpc error: code = Unavailable desc = tra
nsport is closing" remote_addr=11.121.123.123
t=2021-02-15T19:27:11+0000 lvl=eror msg="Request Completed" logger=context userId=1 orgId=1 uname=admin method=POST path=/api/ds/query status=500 remote_a
ddr=11.121.123.123 time_ms=150 size=34 referer="https://xxx.xxx.com.tr/d/axVVVBPMk/xxx?orgId=1
"
t=2021-02-15T19:27:11+0000 lvl=info msg=Profiler logger=plugins.backend pluginId=grafana-iot-sitewise-datasource enabled=false

[bymattoa]

Looks like we are not correctly handling the empty response for GetAssetPropertyValue in the framer:

https://github.com/grafana/iot-sitewise-datasource/blob/main/pkg/framer/property_value.go#L30

Will send a fix out

[nenadilic84]

Just to add that this is occurring in the case where a single panel does not have a valid measurement, others may report Metric request error even though there was no error upon a request

[ryantxu]

Fixed by #82, but still needs to be released.

@nenadilic84 are you able to use a dev build to verify? To get the latest dev build see:
https://github.com/grafana/iot-sitewise-datasource#development-builds

[ryantxu]

This should be fixed -- reopen if you are still having issues