Datasources: Prevent users from overloading Grafana by limiting the amount of data requested/returned

[marefr]

For data source queries, we want to limit the amount of data being returned to/processed by Grafana to prevent Grafana from being overloaded and/or consuming too much resources, such as CPU/memory.

v8.2:

• Datasources: Introduce a max size for datasource responses #35796
• Postgres/MySQL/MSSQL: Introduce a setting for maximum amount of rows returned #38975

v8.2.x

• Do not rely on Content-Length header for datasource response size metric #33372

Unscheduled:

• CloudWatch: Should use the HTTP client provider to create HTTP client for the AWS SDK #39089
• Plugins: External backend data sources should be able to enforce limits for responses #39096

[grafanabot]

This issue was removed from the 8.5.0 milestone because 8.5.0 is currently being released.

[mjseaman]

Hi @marefr , is this still in progress?

[marefr]

@mjseaman I'm afraid not. There was as an attempt to solve the #39089, but we had to revert it since it introduced bugs/weird behaviors and since then we haven't worked on this due to other more prioritized tasks. The main 3 tasks which are solved/done was the most pressing things from grafana cloud perspective to get into place. With that said, this might be something we need to pick up later again.