Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"Dataset exceeds 15000 records, cannot render." when plotting #100

Closed
PathosEthosLogos opened this issue Mar 6, 2020 · 3 comments
Closed

Comments

@PathosEthosLogos
Copy link

Really, really nice library. :)

There is a dataset limitation of 15.000. Any progress on this?

@phillipdupuis
Copy link
Contributor

Hmm. It looks like there are WebGL alternatives (so it'll use your GPU and be way faster) that could be used for line plots, scatter plots, and heatmaps...

I just tested it out myself, and it seems to work quite nicely for 50k data points. So I think there's a good chance this will be added in the next release and the 15k limit will be dropped for line/scatter/heatmaps. The next release should be coming out within the next couple days :)

@phillipdupuis
Copy link
Contributor

phillipdupuis commented Mar 6, 2020

In the meantime, if you really want to make charts with over 15k records and you're okay with it being a bit painfully slow you can cheat and remove the limitation...

Go into dtale/charts/utils.py (it'll probably be in the .../python/site-packages folder), go to the 'check_exceptions' function, and comment out the following code:

    if len(df) > data_limit:
        raise Exception(limit_msg.format(data_limit))

aschonfeld pushed a commit that referenced this issue Mar 7, 2020
 * #100, turned off data limits on charts by using WebGL
 * #99, graceful handling of issue calculating min/max information for Describe popup
 * #91, reshaping of data through usage of aggregations, pivots or transposes
 * Export chart to HTML
 * Export chart dat to CSV
 * Offline chart display for use within notebooks
 * Removal of data from the Instances popup
 * Updated styling of charts to fit full window dimensions
@aschonfeld aschonfeld mentioned this issue Mar 7, 2020
aschonfeld pushed a commit that referenced this issue Mar 7, 2020
 * #100, turned off data limits on charts by using WebGL
 * #99, graceful handling of issue calculating min/max information for Describe popup
 * #91, reshaping of data through usage of aggregations, pivots or transposes
 * Export chart to HTML
 * Export chart dat to CSV
 * Offline chart display for use within notebooks
 * Removal of data from the Instances popup
 * Updated styling of charts to fit full window dimensions
aschonfeld pushed a commit that referenced this issue Mar 7, 2020
 * #100, turned off data limits on charts by using WebGL
 * #99, graceful handling of issue calculating min/max information for Describe popup
 * #91, reshaping of data through usage of aggregations, pivots or transposes
 * Export chart to HTML
 * Export chart dat to CSV
 * Offline chart display for use within notebooks
 * Removal of data from the Instances popup
 * Updated styling of charts to fit full window dimensions
@aschonfeld
Copy link
Collaborator

v1.7.13

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants