Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.Sign up
Slow CSV export - chunk window too small #5172
At our System search queries performing pretty ok but csv exports are very slow.
We enabled debugging (was not enabled before) and think our issue is related to a too small scroll chunk size.
Steps to Reproduce (for bugs)
Using the API we facing slow download speed:
If we set a limit the chunk size increases to the limit size - but as expected we just get the limited amount of messages. That means in this case we get only 1 chunk with 18 messages - queried for 4029 messages:
It looks like the 10 messages for chunk size is a ES default and I found no possibility to overwrite this value.
In older issues it seems there was an default for the chunk size of 500.
To me it looks like a bug that we cannot set the chunk size for the csv export and I do not understand the relationship to the limit parameter.
changed the title from
Slow CSV export
Slow CSV export - chunk window too small
Oct 3, 2018
Thanks for all the work that you put into tracking this down, I'll check with the team for a target version of the fix.
I'm thinking we should default back to