Skip to content

This issue was moved to a discussion.

You can continue the conversation there. Go to discussion →

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

is there any limit or timeout for loading the csv #121

Closed
agkcn opened this issue Aug 19, 2021 · 3 comments
Closed

is there any limit or timeout for loading the csv #121

agkcn opened this issue Aug 19, 2021 · 3 comments
Labels
type/feature-request Requested new feature or enhancement

Comments

@agkcn
Copy link

agkcn commented Aug 19, 2021

Have a very large csv, ~100k rows. Unable to load using the datasource. Is there any limit or timeout which can be tuned to load the entire csv ?

@voruti
Copy link

voruti commented Aug 26, 2021

I think, I got the same problem.

Inside the Grafana "Query inspector" there is an error:

error:"context deadline exceeded (Client.Timeout or context cancellation while reading body)"

I added https://covid.ourworldindata.org/data/owid-covid-data.csv as data source and want to get data from it ...

@marcusolsson
Copy link
Contributor

Even if you increase the timeout, I'm not sure how well Grafana would perform with that amount of data being sent to the browser on each query.

We could introduce some form of server-side filtering to avoid sending the entire file on each query, but you'd still need to download it to the server (unless we cache it on the server).

For very large datasets, I'd probably consider ingesting them into a proper database.

@gdassori
Copy link

Hello, may I bump this? :-)
I don't have a large dataset, but it is processed server-side and cached, so the first request may be slow and would often incur timeouts.

@grafana grafana locked and limited conversation to collaborators Mar 7, 2022
@marcusolsson marcusolsson converted this issue into discussion #178 Mar 7, 2022

This issue was moved to a discussion.

You can continue the conversation there. Go to discussion →

Labels
type/feature-request Requested new feature or enhancement
Projects
None yet
Development

No branches or pull requests

4 participants