Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Additional View methods for faster accessing of row and column data. #2048

Closed
wants to merge 20 commits into from

Conversation

brochington
Copy link
Contributor

Currently much of the data exchange between the perspective data store and charting code happens via calls to to_json. This blanket serialization approach might be better served with more precise data accessing. This is especially true when fetching columnar data, where passing a dict and index array can be much faster.

@texodus texodus marked this pull request as draft December 14, 2022 17:55
@texodus texodus changed the title Draft: Additional View methods for faster accessing of row and column data. Additional View methods for faster accessing of row and column data. Dec 14, 2022
@finos finos deleted a comment from finos-cla-bot bot Dec 14, 2022
@finos finos deleted a comment from finos-cla-bot bot Dec 20, 2022
@finos finos deleted a comment from finos-cla-bot bot Dec 20, 2022
@finos finos locked as spam and limited conversation to collaborators Dec 20, 2022
@texodus
Copy link
Member

texodus commented Feb 27, 2023

Thanks for the PR!

This issue has bit-rotted (The bit-rot could be mostly alleviated by squashing and removing the un-necessary whitespace/auto-format changes) and I don't think we ever got to a consistent design for these APIs, specifically, how they replace/augment the existing `view.col_to_js_typed_array(). I think we've determined (through this work) that the current methods are insufficient for the high-performance chart data pipeline we envisioned, but we're not at a solution yet.

Closing for now, we'll re-visit this in tandem with charting improvements.

@texodus texodus closed this Feb 27, 2023
@timkpaine
Copy link
Member

Also note that any changes like this should also have symmetric changes in python

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants