Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.Sign up
CSV Export issue #4190
The CSV export fails when I am trying to export a search result from more than 7 indices.
The exported CSV files contains the search result data.
The exported CSV file contains only 10 lines
Steps to Reproduce (for bugs)
I am trying to export data to CSV file
I am really sorry but I can't post any responses of requests cause it contains some sensitive data.
But I tried different type of searches in different sets of indices and the behaviour was always the same:
You can of course redact the sensitive parts of the requests and responses in a sensible (and consistent) way, but without you providing any details we'll be unable to reproduce the issue and thus won't be able to help you.
@vladostp Okay, that's the literal CSV file.
Could you try posting the complete HTTP requests and responses (without the response body) when exporting these? You can find them in the Developer Console of your web browser (or just post the output of curl if you're using that).
Also take a look in the logs of your Graylog nodes and check them for useful information.
There definitely does seem to be a problem when the scroll_id gets too large and it switches to POST rather than GET.
So, scroll is bigger than 1900 so it switches over to POST via: https://github.com/searchbox-io/Jest/blob/v5.3.3/jest-common/src/main/java/io/searchbox/core/SearchScroll.java#L15
That post body needs to be a JSON object like it is on new copies of jest.
My guess is that the code we're pulling in is this: https://github.com/searchbox-io/Jest/blob/v2.4.0/jest-common/src/main/java/io/searchbox/core/SearchScroll.java#L24
EDIT: I've confirmed that replacing the class with one that supports the JSON encoding does indeed fix this issue for us.