Describe the bug
In parquet, the code calculating the allocated memory size for util::Interner is wrong:
|
self.dedup.capacity() + std::mem::size_of::<S::Key>() |
The capacity should be multiplied to the item size, but even better, HashTable::allocation_size method is available from the hashbrown library.
Describe the bug
In parquet, the code calculating the allocated memory size for
util::Interneris wrong:arrow-rs/parquet/src/util/interner.rs
Line 82 in d7d9ad3
The capacity should be multiplied to the item size, but even better,
HashTable::allocation_sizemethod is available from the hashbrown library.