Recommended pattern for memory mapped arrays

[bear24rw]

Hi,

I have a 100GB file of floats that I have memory mapped, what would be the recommended pattern for doing things like finding the min and max value or computing a histogram? It seems like DynamicArray is the thing to use but it assumes ownership of the array. I could loop over fixed size chunks and load<>() them into an Array but then I need to deal with the boundary condition at the end if the dataset isn't a multiple of the Array size. What would be your suggestions for this scenario?

[merlinND]

Hi @bear24rw,

Dynamic arrays offer the map(ptr, size) constructor, which does not take ownership of the memory region. Does this work for you?

enoki/include/enoki/dynamic.h

Line 773 in 48dd4c3

static Derived map(void *ptr, size_t size) {

[bear24rw]

I think that's exactly what I need, I didn't see that mentioned anywhere in the docs, thanks!