Possible bug with array.TableReader

[asfimport]

I'm writing an array of int32 to a byte buffer using an array.TableReader and  ipc.Writer. The array is  [1, 2, 3 (null), 4].

I then read it back from the byte buffer using an ipc.Reader.

If the chunk size of the array.TableReader is smaller than the size of the array, the null is ignored.

I read back [1, 2,3, 4].

Is this a bug in my code or apache arrow?

Code attached.

 

Environment: ubuntu20.04, go1.16.13
Reporter: Charlie Hubbard

Original Issue Attachments:

• chunksize.go

_{Note: This issue was originally created as ARROW-15553. Please see the migration documentation for further details.}

[asfimport]

Matthew Topol / @zeroshade:
[~chubbard@adapdix.com] can you test this using Arrow v7? While you're right that this is a bug in the Arrow code, it appears (from my own testing) that this bug was fixed in arrow v7.

You should be able to upgrade to arrow v7 using go get github.com/apache/arrow/go/v7@latest and then changing your import paths to use v7 instead of v6.

[asfimport]

Matthew Topol / @zeroshade:
As far as I can tell this was fixed in an earlier version and is no longer a problem.

[~chubbard@adapdix.com] feel free to reopen if you can reproduce with a newer version of Arrow.