Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[C++] Improve table sort performance #2 #29752

Closed
asfimport opened this issue Sep 29, 2021 · 1 comment
Closed

[C++] Improve table sort performance #2 #29752

asfimport opened this issue Sep 29, 2021 · 1 comment
Assignees
@pitrou
Labels
Component: C++ Type: task
Milestone
6.0.0

Comments

@asfimport
Copy link

asfimport commented Sep 29, 2021 •
edited

After ARROW-10898 is solved, it seems some performance may still be left on the table when merging sorted record batches. Two possible directions:

  • save on chunked indexing by relying on record batches and directly accessing subsequent columns in MultipleKeyComparator
  • use left-to-right "radix" merging

Reporter: Antoine Pitrou / @pitrou
Assignee: Antoine Pitrou / @pitrou

Related issues:

PRs and other links:

Note: This issue was originally created as ARROW-14165. Please see the migration documentation for further details.
@asfimport
Copy link
Author

David Li / @lidavidm:
Issue resolved by pull request 11273
#11273

@asfimport asfimport added this to the 6.0.0 milestone Jan 11, 2023
This was referenced Jan 11, 2023
Closed
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@pitrou pitrou

Labels
Component: C++ Type: task
Projects
None yet
Milestone
6.0.0
Development

No branches or pull requests
2 participants
@pitrou @asfimport