Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Partitions limit #192

Closed
moxious opened this issue Sep 25, 2020 · 1 comment
Closed

Partitions limit #192

moxious opened this issue Sep 25, 2020 · 1 comment

Comments

@moxious
Copy link
Contributor

moxious commented Sep 25, 2020

Being a user who easily makes mistakes, I chose to do a read of a certain label set with 100 partitions and write the resulting dataframe to CSV, within my local docker environment.

Should we cap partitions to some maximum size? I have a hard time imagining that values over say 16 or so are ever going to make sense. Just needs discussion.

@moxious
Copy link
Contributor Author

moxious commented Feb 19, 2021

probably subject to documentation only fix

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants