PERF: Use block-wise parallelism for unique
.
#4916
Labels
P2
Minor bugs or low-priority feature requests
Performance 🚀
Performance related issues and pull requests.
unique
is a full-axis operation in Modin. We should see whether leveraging parallelism across both axes can help us. We could try something likeunique
for each block partitionunique
for each merged resultThis came up here: #4798 (comment)
cc @vnlitvinov
The text was updated successfully, but these errors were encountered: