Dashboard with panels from multiple data sources errors with "-1. Message: Query error: -1 Request was aborted"

[fridgepoet]

What happened:
Setting: a dashboard with at least two panels with different Athena datasources.
Each panel individually contains a query which has results.
When displaying both panels, when dashboard is refreshed, only the final panel will not have the error "-1. Message: Query error: -1 Request was aborted"

What you expected to happen:
All panels should not have an error while refreshing dashboard.

How to reproduce it (as minimally and precisely as possible):

1. In Grafana, add two different Athena data sources.
2. Create a dashboard with a panel with one of the data sources.
3. Successfully query data from this panel. (https://docs.aws.amazon.com/athena/latest/ug/getting-started.html is helpful for setup and querying example if needed)
4. Add another panel with the other data source.
5. Successfully query data on the edit page of this panel.
6. Return to the dashboard page (with both panels displaying).
7. Save the dashboard.
8. Refresh page.
9. The "finalmost" panel will display data, while the other will display the error "-1. Message: Query error: -1 Request was aborted"

For the squad, here is an example: https://clouddatasources.grafana.net/goto/7nO7sU94g?orgId=1

Screenshots

Screen.Recording.2023-07-06.at.18.11.05.mov

Anything else we need to know?:
Same behavior locally (v2.10.1) and on Grafana Cloud (v2.9.6)

Environment:

• Grafana version: Grafana v10.1.0-57684pre (4818568c65) (Cloud), Grafana v10.1.0-pre (1b80df0168) locally
• Plugin version: v2.9.6 on Cloud and v2.10.1 locally
• OS Grafana is installed on: MacOS locally
• User OS & Browser: MacOS and Chrome locally

[jovezhong]

I have been facing this issue for a few months. Please fix it soon.

[iwysiu]

Hi! I just picked this up to investigate. As a workaround for now, you can set the athenaAsyncQueryDataSupport feature toggle to false. Docs on feature toggles

[jovezhong]

Thanks @iwysiu. Is this feature toggle available for regular Grafana Cloud paid customer? Not sure we are at "Grafana Cloud Advanced"

[jovezhong]

Got this

[iwysiu]

Hi @jovezhong ! You should be able to file a support ticket and they'll handle it for you (I double checked and it should still be fine)

[iwysiu]

Hi! I just released v2.13.5, which has the fix for this.

[jovezhong]

Thanks, I confirmed the fix works well.

I just upgraded to 2.13.5 on my Grafana Cloud (glad to see I can click Update directly, without having to go to Grafana admin website). After 1 min, the upgrade is done and my dashboard with multiple athena sources can work well.