You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently some operations assume all rows are in memory (such as order_by). We may move all the code to something lazy.
For order_by specifically we could sort in-disk instead of in-memory, like csvsort does.
Implement LazyTable class
Add lazy parameter to rows.plugins.utils.create_table
Change all plugins to force (or not) lazyness (example: in HTML lazy=False, in CSV lazy=True by default)
Change default sample size to 1000 (or any other non-arbitrary number)
Create documentation about it
The text was updated successfully, but these errors were encountered:
Currently some operations assume all rows are in memory (such as
order_by
). We may move all the code to something lazy.For
order_by
specifically we could sort in-disk instead of in-memory, like csvsort does.LazyTable
classlazy
parameter torows.plugins.utils.create_table
lazy=False
, in CSVlazy=True
by default)The text was updated successfully, but these errors were encountered: