Data viewer with Tabulator

[albertosantini]

Is your feature request related to a problem? Please describe.
Data viewer is using ag-grid.

The load with a lot of rows is slow

1. due to collecting and passing the content (dataframe) to ag-agrid?
2. or due to the rendering of ag-grid because it is not virtual on client-side?

Describe the solution you'd like
Anyone during software selection of ag-grid tried Tabulator lib?
https://tabulator.info/

Describe alternatives you've considered
It seems to me (if I am not wrong) it implements virtual dom on client side and may resolve the slowness if it is due to ag-grid rendering.

A few resources about virtual dom in Tabulator:

• https://tabulator.info/docs/5.5/virtual-dom
• https://tabulator.info/docs/5.5/layout#virtual-dom

Additional context
What do you think?

I was wondering because I don't want proposing a push request reinventing the wheel or just retrying an insuccess. ;)

[eitsupi]

I think the slow loading of data frames is due to the writing and reading of json files.

Perhaps using Arrow can speed up the process?
However, since the arrow package is a very large dependency, we may need to wait until the nanoarrow package supports reading and writing Arrow files.

[albertosantini]

I think the slow loading of data frames is due to the writing and reading of json files.

I was afraid about that ^, anyway I investigate it a bit.
Also I put in my radar nanoarrow.

Thanks @eitsupi.