-
Notifications
You must be signed in to change notification settings - Fork 651
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
speed up _compute_dtypes function #2751
Labels
P2
Minor bugs or low-priority feature requests
Performance 🚀
Performance related issues and pull requests.
Comments
anmyachev
added a commit
to anmyachev/modin
that referenced
this issue
Feb 18, 2021
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev
added a commit
to anmyachev/modin
that referenced
this issue
Feb 18, 2021
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
@anmyachev what's the status of this issue? |
@pyrito need someone to check how long this function takes on the master in the case above. |
7 tasks
@anmyachev
|
Good! |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
P2
Minor bugs or low-priority feature requests
Performance 🚀
Performance related issues and pull requests.
The function works extremely inefficiently when the number of columns is approximately equal to the number of rows.
For example, if
df.shape = (5000, 5000)
andMODIN_CPUS=44
thencount_partitions=44^2
.The text was updated successfully, but these errors were encountered: