Random query errors using the latest version

[stefano-cherchi]

What happened:
EDIT: upon further investigation, the plugin version seems to have no role in the issue. This is the correct scenario.

We've been using a redshift data source (configured using version 1.0.5 of the official RedShift plugin) for months to feed data to dozens of dashboards on Grafana 9.0.5. It all worked flawlessly until last week. This Monday we started seeing some strange behaviour: all the panels using the redshift data source started returning random errors. No changes had been made anywhere in the deployment during the weekend. This is the same dashboard before and after a page refresh:

before:

after refreshing the page:

after opening the Inspect -> Query panel and clicking on "Refresh"

The query inspector always returns this error:

Some times, clicking on the "Refresh" button fixes the issue, some times it doesn't.

The behaviour seems to be totally random.

The same queries return the expected data if run directly against the Redshift database using a local client or the AWS console query editor with the same credentials.

We have updated both Grafana to version 9.1.6 and the plugin to version 1.2.0, to no avail.

Replacing the data source with one that uses the PostgreSQL plugin solves the issue 100% of the times.

What you expected to happen:

I expect all the panels to load consistently with no errors as before the plugin upgrade.

How to reproduce it (as minimally and precisely as possible):

1. Open any panel using a redshift data source
2. See the message "Query error: 500 Internal Server Error"
3. Refresh the page or open the Inspect panel and click on Query -> Refresh
4. The error might or might not disappear, randomly (mostly, it doesn't)

Screenshots

Anything else we need to know?:

Environment:

• Grafana version: 9.0.5 and then 9.1.6
• Plugin version: 1.0.5 and then 1.2.0
• OS Grafana is installed on: Debian 5.10.140-1
• User OS & Browser: MacOS with latest versions of both Chrome and Firefox, Windows with latest version of Chrome
• Others:

[fridgepoet]

Hi, what plugin version did you upgrade from?

[stefano-cherchi]

Hi, what plugin version did you upgrade from?

Hi @fridgepoet , It turns out the issue started before any upgrade. We just upgraded both the plugin and Grafana itself in an attempt to fix the errors. Sorry for the mixup. I've updated the original post to reflect the actual scenario more accurately. The issue, though, is still there and makes absolutely no sense, with panels loading as expected or returning errors with no apparent reason. Using a postgres driver seems to be the only way to fix but I think we must go to the bottom of this issue.

[fridgepoet]

Thanks for updating @stefano-cherchi. I've checked the “Amazon Redshift” importable dashboard on v1.0.5 of the plugin and Grafana v9.0.5 and am getting data.

Is there anything specific about these queries, you think? Or is there an example query and time range you think may be problematic?

[sunker]

We've closed this issue since it needs more information and hasn't had any activity recently. We can re-open it after you you add more information. To avoid having your issue closed in the future, please read our CONTRIBUTING guidelines.