Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

C++: Make jemalloc the default allocator #16734

Closed
asfimport opened this issue Jun 16, 2017 · 3 comments
Closed

C++: Make jemalloc the default allocator #16734

asfimport opened this issue Jun 16, 2017 · 3 comments

Comments

@asfimport
Copy link

While one of the advertised point of Arrow Java is that it comes with an efficient allocator that is based on jemalloc, we only provide jemalloc as an alternative allocator in C++. I would propose to switch to it as the default allocator on all platforms jemalloc is available (i.e. MacOS and Linux) as it provides the following benefits:

Especially for the builders, simply changing the allocator shows speedups between 2x and 10x. In the optimal case, this puts builders nearly on the same level as if one would have pre-allocated the final size.

This change should also include a blog post that outlines the benefits.

Reporter: Uwe Korn / @xhochy
Assignee: Uwe Korn / @xhochy

Note: This issue was originally created as ARROW-1123. Please see the migration documentation for further details.

@asfimport
Copy link
Author

Wes McKinney / @wesm:
This sounds fine to me!

@asfimport
Copy link
Author

Uwe Korn / @xhochy:
PR: #761 This makes jemalloc the default on non-MSVC systems where ARROW_JEMALLOC=ON (the default).

@asfimport
Copy link
Author

Wes McKinney / @wesm:
Issue resolved by pull request 761
#761

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants