Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Export results gives no feedback (and it can take a while if there are many results) #166

Closed
smathot opened this issue Jun 2, 2019 · 2 comments

Comments

@smathot
Copy link

smathot commented Jun 2, 2019

I just collected a large amount of data, that is, about 600 entries of 120 trials each, with many variables per trial. If I choose Export results → All in JATOS, nothing seems to happen for a long while (say 30 s). It does work, and in the end a merged data file is downloaded. But it would be better if there was some visual indication of JATOS working in the meanwhile to avoid people from thinking that JATOS has frozen.

@kristian-lange
Copy link
Member

kristian-lange commented Jun 2, 2019

I agree completely, JATOS should indicate that it is downloading something or preparing a download, (similar to how JATOS handles study uploads).

Another related issue (#159) is that JATOS uses a lot of memory assembling the result data. It first loads all result data into memory and only then sends them to the client. This can lead lead to out-of-memory errors if the result data are big and/or numerous and the server has limited memory.

Both issues can be fixed together. Although right now JATOS has a feature-freeze until the ASSC conference is over, which will be in the end of June. Then it will be the first thing I will do.

@kristian-lange kristian-lange added this to To do in JATOS dev Jun 2, 2019
@kristian-lange kristian-lange moved this from To do to In progress in JATOS dev Jul 25, 2019
@kristian-lange kristian-lange moved this from In progress to Done in JATOS dev Jul 27, 2019
@kristian-lange
Copy link
Member

Added streaming of result data with chunked HTTP response and on the server side only one result is loaded from the DB at the time. This reduces memory consumption and prevents crashing the JVM.
Additionally JATOS UI gives feedback while downloading the results, so users wont get confused if it takes longer.
Will be part in next release (not sure yet if it's called 3.3.7 or 3.4).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
JATOS dev
  
Done
Development

No branches or pull requests

2 participants