[C#] Record Batches in reverse order?

[asfimport]

Are 'RecordBatches' being in C# being written in reverse order?

I made a simple test which creates a single row per record batch of 0 to 99 and attempted to read this in R. To my surprise batch(0) in R had the value 99 not 0

This may not seem like a big deal, however when dealing with 'huge' files, its more efficient to use Record Batches / index lookup than attempting to load the entire file into memory.

Having the order consistent within the different language / API seems only to make sense - for now I can work around this by reversing the order before writing.

 

#5475

 

Reporter: Anthony Abate / @abbotware

Externally tracked issue: #5475

PRs and other links:

• GitHub Pull Request #5412

_{Note: This issue was originally created as ARROW-6681. Please see the migration documentation for further details.}

[asfimport]

Anthony Abate / @abbotware:
sample code in github issue

[CurtHagenlocher]

As of December 2023, this appears to be working correctly.