You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It seems that vaex is not caching selection in memory. I think it will be useful to have an option to cache a selection in memory. It will avoid to go trough all the data again when working on a subset.
One should manage memory limitation, by example by setting a memory buffer limit. One should be warned if the selection exceed buffer limit.
The text was updated successfully, but these errors were encountered:
should cache it, so executing the plot a second time should go faster.
Although caching all selections with some memory limit would be an option, I want to leave it out to keep vaex as simple as possible. I hope this will suffice for the moment.
However, I was testing the performance of this, and found it was not being cached. I fixed this, however, don't expect massive speedups for simple selections. Since having a selection means that the data has to be copied (though this may change in the future), it means a performance penalty for selections.
I'll get back to you on this, in combinations with performance improvements for multiple plots, you may see some speedup, which should also fix #10.
It seems that vaex is not caching selection in memory. I think it will be useful to have an option to cache a selection in memory. It will avoid to go trough all the data again when working on a subset.
One should manage memory limitation, by example by setting a memory buffer limit. One should be warned if the selection exceed buffer limit.
The text was updated successfully, but these errors were encountered: