Skip to content

Conversation

@wesm
Copy link
Member

@wesm wesm commented Sep 5, 2017

I removed some output of pointer contents in the LoggingMemoryPool implementation which was showing up as garbage in the console. Example:

n [1]: import pyarrow as pa

In [2]: import pyarrow.parquet as pq

In [3]: pa.log_memory_allocations(True)

In [4]: t = pq.read_table('/home/wesm/Downloads/part-00000-6570e34b-b42c-4a39-8adf-21d3a97fb87d.snappy.parquet')
Allocate: size = 320
Allocate: size = 64
Allocate: size = 192
Free: size = 192
Allocate: size = 320
Allocate: size = 64
Allocate: size = 192
Allocate: size = 192
Allocate: size = 1152
Allocate: size = 64
Allocate: size = 64
Allocate: size = 64
Reallocate: old_size = 64 - new_size = 128
Reallocate: old_size = 128 - new_size = 192
Reallocate: old_size = 192 - new_size = 320
Reallocate: old_size = 320 - new_size = 576
Reallocate: old_size = 64 - new_size = 128
Reallocate: old_size = 576 - new_size = 1088
Reallocate: old_size = 128 - new_size = 256

wesm added 3 commits September 4, 2017 23:19
Change-Id: I060247992123741d277fe0e32e90aadedc67257a
Change-Id: I1baeab4055a380bc42aace5c126bd6946d6e83a1
Change-Id: I4af0247a4e7a85ed6fe75445d3cc82a85bc616d5
@wesm
Copy link
Member Author

wesm commented Sep 6, 2017

+1

@asfgit asfgit closed this in 54d624b Sep 6, 2017
@wesm wesm deleted the ARROW-1405 branch September 6, 2017 17:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant