ARROW-783: [Java/C++] Fixes for 0-length record batches#505
ARROW-783: [Java/C++] Fixes for 0-length record batches#505wesm wants to merge 1 commit intoapache:masterfrom
Conversation
|
@jacques-n @julienledem this breaks Java with the below. any chance this is related to ARROW-703? |
|
here's the data: https://gist.github.com/wesm/92e90c7fffe0ee10014b40e51c2a2bf2 |
|
FWIW, I rebased this branch on #428 and what's fixed there seems unrelated |
|
I have reproduced this and have it in a debugger. It appears that the problem is that we are trying to truncate a buffer which has had 0 bytes written to it to size 4, which We're doing this because |
|
The offsets vector is 1 more than the length of the array, so for length 0, you probably still want 1 element, even if it's a zero. If you see in the JSON, the offsets vector has one element even https://gist.github.com/wesm/92e90c7fffe0ee10014b40e51c2a2bf2#file-failing_data-json-L1061 |
|
If I remove the Details``` ------------------------------------------------------- T E S T S ------------------------------------------------------- Running org.apache.arrow.vector.TestValueVector Running org.apache.arrow.vector.TestDictionaryVector 16:49:41.744 [main] DEBUG i.n.u.i.l.InternalLoggerFactory - Using SLF4J as the default logging framework 16:49:41.750 [main] DEBUG io.netty.buffer.AbstractByteBuf - -Dio.netty.buffer.bytebuf.checkAccessible: true 16:49:41.754 [main] DEBUG io.netty.util.ResourceLeakDetector - -Dio.netty.leakDetection.level: simple 16:49:41.755 [main] DEBUG io.netty.util.ResourceLeakDetector - -Dio.netty.leakDetection.maxRecords: 4 16:49:41.779 [main] DEBUG i.n.util.internal.PlatformDependent0 - java.nio.Buffer.address: available 16:49:41.780 [main] DEBUG i.n.util.internal.PlatformDependent0 - sun.misc.Unsafe.theUnsafe: available 16:49:41.783 [main] DEBUG i.n.util.internal.PlatformDependent0 - sun.misc.Unsafe.copyMemory: available 16:49:41.784 [main] DEBUG i.n.util.internal.PlatformDependent0 - direct buffer constructor: available 16:49:41.786 [main] DEBUG i.n.util.internal.PlatformDependent0 - java.nio.Bits.unaligned: available, true 16:49:41.787 [main] DEBUG i.n.util.internal.PlatformDependent0 - java.nio.DirectByteBuffer.(long, int): available 16:49:41.788 [main] DEBUG io.netty.util.internal.Cleaner0 - java.nio.ByteBuffer.cleaner(): available 16:49:41.791 [main] DEBUG i.n.util.internal.PlatformDependent - Java version: 8 16:49:41.791 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.noUnsafe: false 16:49:41.791 [main] DEBUG i.n.util.internal.PlatformDependent - sun.misc.Unsafe: available 16:49:41.792 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.noJavassist: false 16:49:41.797 [main] DEBUG i.n.util.internal.PlatformDependent - Javassist: unavailable 16:49:41.797 [main] DEBUG i.n.util.internal.PlatformDependent - You don't have Javassist in your class path or you don't have enough permission to load dynamically generated classes. Please check the configuration for better performance. 16:49:41.797 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.tmpdir: /home/leif/git/arrow/java/vector/target (java.io.tmpdir) 16:49:41.797 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.bitMode: 64 (sun.arch.data.model) 16:49:41.797 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.noPreferDirect: false 16:49:41.798 [main] DEBUG i.n.util.internal.PlatformDependent - io.netty.maxDirectMemory: 1836580864 bytes 16:49:41.798 [main] DEBUG i.n.util.ResourceLeakDetectorFactory - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@cb5822 16:49:41.803 [main] DEBUG i.n.u.i.l.InternalLoggerFactory - Using SLF4J as the default logging framework 16:49:41.815 [main] DEBUG io.netty.buffer.AbstractByteBuf - -Dio.netty.buffer.bytebuf.checkAccessible: true 16:49:41.821 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.numHeapArenas: 8 16:49:41.821 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.numDirectArenas: 8 16:49:41.822 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.pageSize: 8192 16:49:41.822 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.maxOrder: 11 16:49:41.822 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.chunkSize: 16777216 16:49:41.822 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.tinyCacheSize: 512 16:49:41.823 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.smallCacheSize: 256 16:49:41.823 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.normalCacheSize: 64 16:49:41.824 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 16:49:41.824 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.cacheTrimInterval: 8192 16:49:41.821 [main] DEBUG io.netty.util.ResourceLeakDetector - -Dio.netty.leakDetection.level: simple 16:49:41.826 [main] DEBUG io.netty.util.ResourceLeakDetector - -Dio.netty.leakDetection.maxRecords: 4 16:49:41.871 [main] DEBUG i.n.util.internal.PlatformDependent0 - java.nio.Buffer.address: available 16:49:41.875 [main] DEBUG i.n.util.internal.PlatformDependent0 - sun.misc.Unsafe.theUnsafe: available 16:49:41.878 [main] DEBUG i.n.util.internal.PlatformDependent0 - sun.misc.Unsafe.copyMemory: available 16:49:41.879 [main] DEBUG i.n.util.internal.PlatformDependent0 - direct buffer constructor: available 16:49:41.881 [main] DEBUG i.n.util.internal.PlatformDependent0 - java.nio.Bits.unaligned: available, true 16:49:41.881 [main] DEBUG i.n.util.internal.PlatformDependent0 - java.nio.DirectByteBuffer.(long, int): available 16:49:41.883 [main] DEBUG io.netty.util.internal.Cleaner0 - java.nio.ByteBuffer.cleaner(): available 16:49:41.884 [main] DEBUG i.n.util.internal.PlatformDependent - Java version: 8 16:49:41.884 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.noUnsafe: false 16:49:41.885 [main] DEBUG i.n.util.internal.PlatformDependent - sun.misc.Unsafe: available 16:49:41.885 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.noJavassist: false 16:49:41.887 [main] DEBUG i.n.util.internal.PlatformDependent - Javassist: unavailable 16:49:41.887 [main] DEBUG i.n.util.internal.PlatformDependent - You don't have Javassist in your class path or you don't have enough permission to load dynamically generated classes. Please check the configuration for better performance. 16:49:41.888 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.tmpdir: /home/leif/git/arrow/java/vector/target (java.io.tmpdir) 16:49:41.888 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.bitMode: 64 (sun.arch.data.model) 16:49:41.888 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.noPreferDirect: false 16:49:41.889 [main] DEBUG i.n.util.internal.PlatformDependent - io.netty.maxDirectMemory: 1836580864 bytes 16:49:41.890 [main] DEBUG i.n.util.ResourceLeakDetectorFactory - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@cb5822 16:49:41.911 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.numHeapArenas: 8 16:49:41.911 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.numDirectArenas: 8 16:49:41.911 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.pageSize: 8192 16:49:41.912 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.maxOrder: 11 16:49:41.912 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.chunkSize: 16777216 16:49:41.912 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.tinyCacheSize: 512 16:49:41.912 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.smallCacheSize: 256 16:49:41.913 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.normalCacheSize: 64 16:49:41.913 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 16:49:41.913 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.cacheTrimInterval: 8192 16:49:42.007 [main] DEBUG io.netty.util.Recycler - -Dio.netty.recycler.maxCapacity.default: 32768 16:49:42.007 [main] DEBUG io.netty.util.Recycler - -Dio.netty.recycler.maxSharedCapacityFactor: 2 16:49:42.007 [main] DEBUG io.netty.util.Recycler - -Dio.netty.recycler.linkCapacity: 16 16:49:42.007 [main] DEBUG io.netty.util.Recycler - -Dio.netty.recycler.ratio: 8 16:49:42.013 [main] DEBUG i.n.util.internal.PlatformDependent - org.jctools-core.MpscChunkedArrayQueue: available 16:49:42.031 [main] DEBUG org.apache.arrow.vector.Float4Vector - Reallocating vector [$values$]. # of bytes: [4096] -> [8192] 16:49:42.047 [main] DEBUG org.apache.arrow.vector.Float4Vector - Reallocating vector [$values$]. # of bytes: [8192] -> [16384] 16:49:42.060 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:42.089 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:42.098 [main] DEBUG io.netty.util.Recycler - -Dio.netty.recycler.maxCapacity.default: 32768 16:49:42.098 [main] DEBUG io.netty.util.Recycler - -Dio.netty.recycler.maxSharedCapacityFactor: 2 16:49:42.098 [main] DEBUG io.netty.util.Recycler - -Dio.netty.recycler.linkCapacity: 16 16:49:42.098 [main] DEBUG io.netty.util.Recycler - -Dio.netty.recycler.ratio: 8 16:49:42.104 [main] DEBUG i.n.util.internal.PlatformDependent - org.jctools-core.MpscChunkedArrayQueue: available 16:49:42.108 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:42.121 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:42.133 [main] DEBUG org.apache.arrow.vector.UInt4Vector - Reallocating vector [$offsets$]. # of bytes: [16] -> [32] 16:49:42.166 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:42.180 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.315 sec - in org.apache.arrow.vector.TestDictionaryVector Running org.apache.arrow.vector.complex.impl.TestPromotableWriter 16:49:42.326 [main] DEBUG o.a.a.v.c.AbstractContainerVector - Field [A] mutated from [NullableBitVector] to [UnionVector] 16:49:42.390 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:42.397 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:42.402 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:42.403 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.198 sec - in org.apache.arrow.vector.complex.impl.TestPromotableWriter Running org.apache.arrow.vector.complex.writer.TestComplexWriter 16:49:42.418 [main] DEBUG org.apache.arrow.vector.UInt4Vector - Reallocating vector [$offsets$]. # of bytes: [16384] -> [32768] 16:49:42.422 [main] DEBUG org.apache.arrow.vector.UInt4Vector - Reallocating vector [$offsets$]. # of bytes: [32768] -> [65536] 16:49:42.426 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.601 sec - in org.apache.arrow.vector.TestValueVector Running org.apache.arrow.vector.file.TestArrowFile 16:49:42.545 [main] DEBUG o.a.a.v.c.AbstractContainerVector - Field [a] mutated from [NullableBigIntVector] to [UnionVector] 16:49:42.685 [main] DEBUG org.apache.arrow.vector.UInt1Vector - Reallocating vector [types]. # of bytes: [4096] -> [8192] 16:49:42.893 [main] DEBUG org.apache.arrow.vector.UInt1Vector - Reallocating vector [types]. # of bytes: [4096] -> [8192] 16:49:42.917 [main] DEBUG o.a.a.v.c.AbstractContainerVector - Field [a] mutated from [NullableBigIntVector] to [UnionVector] 16:49:42.926 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:42.927 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:42.927 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 9 16:49:42.929 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:42.929 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:42.930 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 9 16:49:42.932 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - writing schema: Schema 16:49:42.932 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:42.953 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:42.953 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 232 16:49:42.955 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:42.955 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 208 16:49:42.962 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:42.962 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:42.962 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:42.962 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:42.962 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 9 16:49:42.963 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - DictionaryRecordBatch at 242, metadata: 214, body: 41 16:49:42.964 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:42.964 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 232 16:49:42.965 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:42.965 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 208 16:49:42.965 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:42.965 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:42.965 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:42.965 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 9 16:49:42.965 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - DictionaryRecordBatch at 236, metadata: 212, body: 41 16:49:42.966 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:42.966 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 24 16:49:42.966 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:42.967 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:42.967 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 3 16:49:42.967 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:42.967 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:42.967 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 24 16:49:42.969 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 489, metadata: 159, body: 32 16:49:42.975 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:42.975 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 24 16:49:42.977 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:42.977 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:42.977 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 3 16:49:42.977 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:42.977 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:42.977 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 24 16:49:42.981 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 481, metadata: 159, body: 32 16:49:42.981 [main] DEBUG org.apache.arrow.vector.UInt1Vector - Reallocating vector [types]. # of bytes: [4096] -> [8192] 16:49:42.984 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 304 16:49:42.984 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:42.985 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 680, length: 304 16:49:42.985 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:42.985 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 994 16:49:42.985 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:42.987 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors]. 16:49:42.990 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10 16:49:42.990 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 680, length: 304 16:49:42.990 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 304 16:49:42.994 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema 16:49:42.995 [main] DEBUG o.a.a.vector.file.ArrowFileReader - DictionaryRecordBatch at 242, metadata: 214, body: 41 16:49:42.996 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 255 16:49:42.998 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:42.999 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:42.999 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 9 16:49:43.001 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 489, metadata: 159, body: 32 16:49:43.005 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 191 16:49:43.007 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.008 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 24 16:49:43.019 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.020 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.020 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 232 16:49:43.020 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema 16:49:43.020 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.020 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 208 16:49:43.023 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 33 16:49:43.024 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.024 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.024 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 9 16:49:43.025 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.025 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 155 16:49:43.026 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 32 16:49:43.026 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.027 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 24 16:49:43.033 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.033 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.059 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.063 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 12 16:49:43.063 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 6 16:49:43.064 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.065 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 12 16:49:43.069 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 6 16:49:43.069 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - writing schema: Schema> 16:49:43.069 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.071 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.071 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 328 16:49:43.072 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.072 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 208 16:49:43.072 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.072 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:43.072 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:43.072 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 12 16:49:43.072 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.072 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.073 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - DictionaryRecordBatch at 338, metadata: 214, body: 38 16:49:43.075 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.075 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 328 16:49:43.076 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.076 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 208 16:49:43.076 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:43.076 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:43.076 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 12 16:49:43.076 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.076 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.076 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - DictionaryRecordBatch at 332, metadata: 212, body: 38 16:49:43.078 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.078 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.078 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 1 16:49:43.078 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 32, length: 16 16:49:43.079 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.079 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216 16:49:43.079 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.079 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:43.079 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:43.079 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.079 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:43.079 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:43.080 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.080 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 582, metadata: 226, body: 48 16:49:43.081 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.081 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.081 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 1 16:49:43.082 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 32, length: 16 16:49:43.082 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.082 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216 16:49:43.082 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.082 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:43.083 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:43.083 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.083 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:43.083 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:43.084 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.084 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 574, metadata: 226, body: 48 16:49:43.086 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 400 16:49:43.086 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.086 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 856, length: 400 16:49:43.088 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.088 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 1266 16:49:43.088 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.092 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10 16:49:43.092 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 856, length: 400 16:49:43.092 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 400 16:49:43.095 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema> 16:49:43.095 [main] DEBUG o.a.a.vector.file.ArrowFileReader - DictionaryRecordBatch at 338, metadata: 214, body: 38 16:49:43.096 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 252 16:49:43.098 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.098 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 12 16:49:43.098 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 6 16:49:43.100 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 582, metadata: 226, body: 48 16:49:43.107 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 274 16:49:43.111 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.111 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.111 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 1 16:49:43.112 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 32, length: 16 16:49:43.134 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.135 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.135 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 328 16:49:43.136 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema> 16:49:43.136 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.137 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 208 16:49:43.137 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 30 16:49:43.139 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.139 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 12 16:49:43.139 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 6 16:49:43.141 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.141 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 222 16:49:43.142 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 48 16:49:43.144 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.148 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.151 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 1 16:49:43.152 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 32, length: 16 16:49:43.156 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.156 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.209 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - writing schema: Schema 16:49:43.210 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.213 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.213 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 252 16:49:43.213 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.214 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.214 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.214 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.214 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.214 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216 16:49:43.214 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.215 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.215 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.215 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.215 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.215 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.215 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.215 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 262, metadata: 226, body: 136 Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.803 sec - in org.apache.arrow.vector.complex.writer.TestComplexWriter 16:49:43.216 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 296 16:49:43.216 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.216 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 624, length: 296 16:49:43.216 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.216 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 930 16:49:43.216 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.216 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 252 16:49:43.217 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.217 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.217 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.217 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.217 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.217 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216 16:49:43.218 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.218 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.218 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.218 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.218 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.218 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.218 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.218 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 256, metadata: 224, body: 136 16:49:43.218 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 Running org.apache.arrow.vector.file.TestArrowFooter 16:49:43.236 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors]. 16:49:43.237 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.248 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - writing schema: Schema 16:49:43.249 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.249 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.249 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 176 16:49:43.249 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.249 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.250 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.250 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.250 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.250 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.250 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.250 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.250 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 186, metadata: 158, body: 24 16:49:43.250 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 224 16:49:43.250 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.251 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 368, length: 224 16:49:43.251 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.251 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 602 16:49:43.251 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.251 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 176 16:49:43.251 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.251 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.252 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.252 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.252 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.252 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.252 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.252 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 180, metadata: 156, body: 24 16:49:43.252 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.253 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10 16:49:43.254 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 368, length: 224 16:49:43.254 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 224 16:49:43.254 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema 16:49:43.254 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 186, metadata: 158, body: 24 16:49:43.255 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 182 16:49:43.256 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.256 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.258 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[fileReader]. 16:49:43.258 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.258 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 176 16:49:43.258 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema 16:49:43.258 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.258 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 152 16:49:43.259 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24 16:49:43.259 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.259 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.260 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[streamReader]. 16:49:43.261 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.292 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - writing schema: Schema, map: Struct not null> 16:49:43.292 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.293 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.293 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 612 16:49:43.295 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.295 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.295 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.295 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.295 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 136, length: 2 16:49:43.295 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 144, length: 44 16:49:43.296 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 192, length: 2 16:49:43.296 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 200, length: 40 16:49:43.296 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 240, length: 27 16:49:43.296 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 272, length: 2 16:49:43.296 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 280, length: 2 16:49:43.296 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 288, length: 80 16:49:43.296 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.296 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 472 16:49:43.296 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.296 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 44 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 27 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 5 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.298 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.298 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.298 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 622, metadata: 482, body: 368 16:49:43.299 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 656 16:49:43.299 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.299 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 1472, length: 656 16:49:43.299 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.299 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 2138 16:49:43.300 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.300 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 612 16:49:43.301 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.301 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.301 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.301 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.301 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 136, length: 2 16:49:43.301 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 144, length: 44 16:49:43.302 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 192, length: 2 16:49:43.302 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 200, length: 40 16:49:43.302 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 240, length: 27 16:49:43.302 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 272, length: 2 16:49:43.302 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 280, length: 2 16:49:43.302 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 288, length: 80 16:49:43.303 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.307 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 472 16:49:43.308 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.308 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.308 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.309 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 44 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 27 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 5 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.311 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.311 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 616, metadata: 480, body: 368 16:49:43.312 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.315 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors]. 16:49:43.315 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10 16:49:43.315 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 1472, length: 656 16:49:43.315 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 656 16:49:43.316 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema, map: Struct not null> 16:49:43.316 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 622, metadata: 482, body: 368 16:49:43.317 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 850 16:49:43.321 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.321 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.322 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.322 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.322 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 136, length: 2 16:49:43.322 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 144, length: 44 16:49:43.322 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 192, length: 2 16:49:43.322 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 200, length: 40 16:49:43.323 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 240, length: 27 16:49:43.323 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 272, length: 2 16:49:43.323 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 280, length: 2 16:49:43.323 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 288, length: 80 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - int 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 0 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 4 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 5 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 6 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 7 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 9 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - bigInt 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 0 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1 16:49:43.332 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2 16:49:43.332 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 3 16:49:43.332 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 4 16:49:43.332 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 5 16:49:43.332 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 6 16:49:43.332 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 7 16:49:43.332 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 8 16:49:43.332 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 9 16:49:43.332 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - list 16:49:43.347 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.355 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.355 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.355 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.355 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.355 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.355 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.355 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.355 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.356 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.356 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - map Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.192 sec - in org.apache.arrow.vector.file.TestArrowFooter Running org.apache.arrow.vector.file.TestArrowReaderWriter 16:49:43.431 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.431 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.434 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.435 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.435 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.435 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.435 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.435 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.436 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 0, metadata: 160, body: 24 16:49:43.436 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.436 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.437 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 176 16:49:43.437 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 224 16:49:43.437 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.437 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 370, length: 224 16:49:43.437 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.437 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 604 16:49:43.441 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10 16:49:43.441 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 370, length: 224 16:49:43.441 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 224 16:49:43.442 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 0, metadata: 160, body: 24 16:49:43.443 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 184 16:49:43.445 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.445 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.032 sec - in org.apache.arrow.vector.file.TestArrowReaderWriter Running org.apache.arrow.vector.file.TestArrowStream 16:49:43.460 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.460 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 176 16:49:43.461 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.461 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.461 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.462 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.462 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.462 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.462 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.462 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 180, metadata: 156, body: 24 16:49:43.462 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.463 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.463 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 176 16:49:43.464 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.464 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 152 16:49:43.465 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24 16:49:43.466 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.466 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":0,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7200000,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.466 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.466 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":1,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":1,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199999,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.467 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":2,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":2,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199998,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.467 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.467 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":3,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":3,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199997,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.468 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":4,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":4,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199996,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.468 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.468 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":5,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":5,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199995,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.469 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":6,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":6,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199994,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.469 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.469 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 176 16:49:43.469 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.470 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.470 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 176 16:49:43.470 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.470 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.470 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":7,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":7,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199993,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.471 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.471 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":8,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":8,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199992,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.471 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":9,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":9,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199991,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.022 sec - in org.apache.arrow.vector.file.TestArrowStream Running org.apache.arrow.vector.file.json.TestJSONFile 16:49:43.476 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.477 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.477 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 612 16:49:43.478 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema, map: Struct not null> 16:49:43.478 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.478 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 476 16:49:43.479 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 368 16:49:43.482 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.482 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.482 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.483 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.483 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 136, length: 2 16:49:43.483 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 144, length: 44 16:49:43.483 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 192, length: 2 16:49:43.483 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 200, length: 40 16:49:43.484 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 240, length: 27 16:49:43.484 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 272, length: 2 16:49:43.484 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 280, length: 2 16:49:43.484 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 288, length: 80 16:49:43.490 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - int 16:49:43.490 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 0 16:49:43.490 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1 16:49:43.490 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 4 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 5 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 6 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 7 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 9 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - bigInt 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 0 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 3 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 4 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 5 16:49:43.492 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 6 16:49:43.492 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 7 16:49:43.492 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 8 16:49:43.492 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 9 16:49:43.492 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - list 16:49:43.492 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.492 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.492 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.492 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.493 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.493 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.493 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.493 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.493 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.493 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.493 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - map 16:49:43.494 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":0,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7200000,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.494 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":1,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":1,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199999,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.495 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":2,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":2,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199998,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.495 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":3,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":3,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199997,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.495 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":4,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":4,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199996,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.524 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":5,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":5,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199995,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.525 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":6,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":6,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199994,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.528 [main] DEBUG o.a.a.vector.file.json.TestJSONFile - reading schema: Schema> 16:49:43.526 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":7,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":7,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199993,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.526 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":8,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":8,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199992,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.526 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":9,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":9,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199991,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.529 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.529 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.538 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.538 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - writing schema: Schema 16:49:43.539 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.539 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.539 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.539 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 252 16:49:43.539 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.540 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.540 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.540 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.540 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.540 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216 16:49:43.540 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.540 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.540 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.541 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.541 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.541 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.541 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.541 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 262, metadata: 226, body: 136 16:49:43.542 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 296 16:49:43.542 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.542 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 624, length: 296 16:49:43.542 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.542 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 930 16:49:43.548 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.548 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 252 16:49:43.548 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.549 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.549 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.549 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.549 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.549 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216 16:49:43.549 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.549 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.549 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.549 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.549 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.549 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.549 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.549 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 256, metadata: 224, body: 136 16:49:43.550 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.551 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors]. 16:49:43.551 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10 16:49:43.552 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 624, length: 296 16:49:43.552 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 296 16:49:43.552 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema 16:49:43.552 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 262, metadata: 226, body: 136 16:49:43.553 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 362 16:49:43.555 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.556 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.556 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.556 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.559 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.559 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.559 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 252 16:49:43.560 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema 16:49:43.560 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.560 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 220 16:49:43.560 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 136 16:49:43.562 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.562 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.562 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.562 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.565 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.566 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.571 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.571 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.571 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 252 16:49:43.572 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.572 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 252 16:49:43.572 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.572 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.572 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.572 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.572 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.572 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216 16:49:43.572 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.572 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.573 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.573 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.573 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.573 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.573 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.573 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 262, metadata: 226, body: 136 16:49:43.573 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.573 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.573 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.573 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.574 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.574 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216 16:49:43.574 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.574 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.574 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.574 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.574 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.574 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.574 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.574 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 256, metadata: 224, body: 136 16:49:43.578 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.578 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 20 16:49:43.578 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 32, length: 1 16:49:43.578 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 40, length: 40 16:49:43.578 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.578 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216 16:49:43.578 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.578 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:43.578 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:43.578 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 20 16:49:43.578 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.579 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:43.579 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:43.579 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.579 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 624, metadata: 224, body: 80 16:49:43.580 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.580 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 20 16:49:43.580 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 32, length: 1 16:49:43.580 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 40, length: 40 16:49:43.580 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.581 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216 16:49:43.581 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.581 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:43.581 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:43.581 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 20 16:49:43.581 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.581 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:43.581 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:43.581 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.581 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 616, metadata: 224, body: 80 16:49:43.584 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 320 16:49:43.587 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.587 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 928, length: 320 16:49:43.587 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.587 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 1258 16:49:43.587 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.588 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors]. 16:49:43.589 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10 16:49:43.590 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 928, length: 320 16:49:43.590 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 320 16:49:43.590 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema 16:49:43.590 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 262, metadata: 226, body: 136 16:49:43.590 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 362 16:49:43.592 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.592 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.592 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.592 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.595 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 624, metadata: 224, body: 80 16:49:43.595 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 304 16:49:43.597 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.597 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 20 16:49:43.597 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 32, length: 1 16:49:43.597 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 40, length: 40 16:49:43.599 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.599 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.599 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 252 16:49:43.600 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema 16:49:43.600 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.600 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 220 16:49:43.600 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 136 16:49:43.601 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.601 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.601 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.601 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.604 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.604 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 220 16:49:43.604 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 80 16:49:43.606 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.606 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 20 16:49:43.606 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 32, length: 1 16:49:43.606 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 40, length: 40 16:49:43.609 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.609 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.610 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - int 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 0 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 4 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 5 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 6 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 7 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 9 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - bigInt 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 0 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 3 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 4 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 5 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 6 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 7 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 8 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 9 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - list 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.620 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.620 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.620 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.620 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.620 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.620 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.620 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.620 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.620 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.620 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - map 16:49:43.621 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":0,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7200000,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.621 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":1,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":1,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199999,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.621 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":2,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":2,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199998,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.622 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":3,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":3,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199997,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.622 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":4,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":4,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199996,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.622 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":5,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":5,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199995,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.624 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":6,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":6,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199994,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.625 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":7,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":7,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199993,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.625 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":8,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":8,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199992,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.625 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":9,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":9,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199991,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.626 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - writing schema: Schema, map: Struct not null> 16:49:43.626 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.626 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.627 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 612 16:49:43.627 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.627 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.627 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.628 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.628 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 136, length: 2 16:49:43.628 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 144, length: 44 16:49:43.628 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 192, length: 2 16:49:43.628 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 200, length: 40 16:49:43.628 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 240, length: 27 16:49:43.629 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 272, length: 2 16:49:43.633 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors]. 16:49:43.633 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 280, length: 2 16:49:43.633 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 288, length: 80 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 472 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 44 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 27 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 5 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.635 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.635 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.635 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.635 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 622, metadata: 482, body: 368 16:49:43.636 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 656 16:49:43.637 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.637 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 1472, length: 656 16:49:43.637 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.637 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 2138 16:49:43.637 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.637 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 612 16:49:43.638 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.638 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.638 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.638 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.638 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 136, length: 2 16:49:43.638 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 144, length: 44 16:49:43.638 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 192, length: 2 16:49:43.639 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 200, length: 40 16:49:43.639 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 240, length: 27 16:49:43.639 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 272, length: 2 16:49:43.639 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 280, length: 2 16:49:43.639 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 288, length: 80 16:49:43.639 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.639 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 472 16:49:43.639 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.639 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 44 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 27 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 5 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 616, metadata: 480, body: 368 16:49:43.641 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.643 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors]. 16:49:43.644 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.653 [main] DEBUG o.a.a.v.c.AbstractContainerVector - Field [union] mutated from [NullableIntVector] to [UnionVector] 16:49:43.653 [main] DEBUG o.a.a.vector.file.json.TestJSONFile - reading schema: Schema, map: Struct not null> 16:49:43.666 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - int 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 0 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 4 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 5 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 6 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 7 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 9 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - bigInt 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 0 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 3 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 4 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 5 16:49:43.668 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 6 16:49:43.668 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 7 16:49:43.668 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 8 16:49:43.668 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 9 16:49:43.668 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - list 16:49:43.671 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.676 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - writing schema: Schema, map: Struct not null>> 16:49:43.676 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.679 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.679 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.679 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.680 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.680 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.680 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 708 16:49:43.681 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 10 16:49:43.681 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 16, length: 2 16:49:43.681 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 40 16:49:43.681 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 64, length: 2 16:49:43.681 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.681 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 72, length: 80 16:49:43.681 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.682 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 152, length: 2 16:49:43.682 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 160, length: 44 16:49:43.682 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.682 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 208, length: 1 16:49:43.682 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 216, length: 12 16:49:43.682 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.682 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.682 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 232, length: 6 16:49:43.682 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - map 16:49:43.682 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 240, length: 2 16:49:43.688 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 248, length: 2 16:49:43.689 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 256, length: 80 16:49:43.689 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.689 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 512 16:49:43.689 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.689 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 10 16:49:43.689 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.689 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.689 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.689 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.689 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.695 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 44 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 12 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 718, metadata: 522, body: 336 16:49:43.698 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 752 16:49:43.698 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.698 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 1576, length: 752 16:49:43.698 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.698 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 2338 16:49:43.699 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.699 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 708 16:49:43.700 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 10 16:49:43.700 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 16, length: 2 16:49:43.700 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 40 16:49:43.700 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 64, length: 2 16:49:43.700 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 72, length: 80 16:49:43.700 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 152, length: 2 16:49:43.700 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 160, length: 44 16:49:43.701 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 208, length: 1 16:49:43.706 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 216, length: 12 16:49:43.707 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 232, length: 6 16:49:43.707 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 240, length: 2 16:49:43.707 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 248, length: 2 16:49:43.707 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 256, length: 80 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 512 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 10 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 44 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 12 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 712, metadata: 520, body: 336 16:49:43.709 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.712 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors]. 16:49:43.712 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10 16:49:43.712 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 1576, length: 752 16:49:43.712 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 752 16:49:43.713 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema, map: Struct not null>> 16:49:43.713 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 718, metadata: 522, body: 336 16:49:43.713 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 858 16:49:43.716 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 10 16:49:43.717 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 16, length: 2 16:49:43.717 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 40 16:49:43.717 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 64, length: 2 16:49:43.717 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 72, length: 80 16:49:43.717 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 152, length: 2 16:49:43.717 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 160, length: 44 16:49:43.717 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 208, length: 1 16:49:43.718 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 216, length: 12 16:49:43.718 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 232, length: 6 16:49:43.718 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 240, length: 2 16:49:43.718 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 248, length: 2 16:49:43.718 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 256, length: 80 16:49:43.722 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":0,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7200000,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.722 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":1,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":1,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199999,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.723 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":2,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":2,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199998,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.723 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":3,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":3,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199997,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.723 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":4,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":4,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199996,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.724 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":5,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":5,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199995,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.724 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":6,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":6,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199994,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.725 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":7,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":7,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199993,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.726 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":8,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":8,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199992,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.726 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":9,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":9,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199991,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.730 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.730 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.733 [main] DEBUG o.a.a.v.c.AbstractContainerVector - Field [union] mutated from [NullableIntVector] to [UnionVector] 16:49:43.739 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - root 16:49:43.739 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.739 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.739 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.739 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.739 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.739 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.739 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.739 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.739 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.740 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.751 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.752 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.752 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 708 16:49:43.765 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema, map: Struct not null>> 16:49:43.765 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.765 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 516 16:49:43.766 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 336 16:49:43.771 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 10 16:49:43.771 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 16, length: 2 16:49:43.771 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 40 16:49:43.771 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 64, length: 2 16:49:43.772 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 72, length: 80 16:49:43.772 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 152, length: 2 16:49:43.772 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 160, length: 44 16:49:43.772 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 208, length: 1 16:49:43.772 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 216, length: 12 16:49:43.772 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 232, length: 6 16:49:43.772 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 240, length: 2 16:49:43.772 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 248, length: 2 16:49:43.773 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 256, length: 80 16:49:43.783 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.784 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.348 sec - in org.apache.arrow.vector.file.TestArrowFile Running org.apache.arrow.vector.file.TestArrowStreamPipe 16:49:43.800 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors]. 16:49:43.811 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.811 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 176 16:49:43.813 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.813 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.813 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.813 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.813 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.814 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.814 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.814 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 180, metadata: 156, body: 24 16:49:43.814 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.815 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.815 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.815 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.815 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.815 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.815 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.815 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.815 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 360, metadata: 160, body: 24 16:49:43.816 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.816 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.816 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.816 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.816 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.816 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.816 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.816 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.816 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 544, metadata: 160, body: 24 16:49:43.817 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.818 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.819 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.819 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.819 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.819 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.823 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.823 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 176 16:49:43.824 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.824 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 152 16:49:43.824 [main] DEBUG o.a.a.vector.file.json.TestJSONFile - reading schema: Schema, map: Struct not null>> 16:49:43.824 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.824 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.824 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 728, metadata: 160, body: 24 16:49:43.825 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24 16:49:43.825 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.825 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.826 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.826 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.826 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.826 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.826 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.826 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.826 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 912, metadata: 160, body: 24 16:49:43.827 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.827 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.827 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.827 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.827 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.827 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.827 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.827 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.827 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 1096, metadata: 160, body: 24 16:49:43.828 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.828 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.828 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.828 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.828 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.828 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.828 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.828 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.828 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.828 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.828 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 1280, metadata: 160, body: 24 16:49:43.828 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.828 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156 16:49:43.829 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24 16:49:43.829 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.829 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.830 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.838 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156 16:49:43.838 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24 16:49:43.839 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.839 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.841 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[final vectors]. 16:49:43.841 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.833 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.841 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.841 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.841 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.841 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156 16:49:43.841 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.841 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.841 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.841 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.841 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.841 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 1464, metadata: 160, body: 24 16:49:43.841 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.842 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24 16:49:43.842 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.842 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.843 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.843 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.843 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.843 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156 16:49:43.843 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.843 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.843 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.843 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.843 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.843 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.843 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 1648, metadata: 160, body: 24 16:49:43.844 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.844 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.844 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.844 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.844 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.844 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.844 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.844 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.844 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 1832, metadata: 160, body: 24 16:49:43.844 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.844 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24 16:49:43.845 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.845 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.846 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.846 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156 16:49:43.847 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24 16:49:43.847 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.847 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.848 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.848 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156 16:49:43.848 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24 16:49:43.849 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.849 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.849 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.850 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156 16:49:43.850 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24 16:49:43.850 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.850 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.851 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.851 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156 16:49:43.851 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24 16:49:43.852 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.852 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.852 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.853 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156 16:49:43.853 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24 16:49:43.853 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.853 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.854 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.858 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - int 16:49:43.858 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 0 16:49:43.858 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 4 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 5 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 6 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 7 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 9 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - bigInt 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 0 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 3 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 4 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 5 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 6 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 7 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 8 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 9 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - list 16:49:43.860 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.860 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.860 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.860 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.860 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.860 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.860 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.861 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.861 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.861 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.861 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - map Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.074 sec - in org.apache.arrow.vector.file.TestArrowStreamPipe Running org.apache.arrow.vector.TestUnionVector 16:49:43.861 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":0,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7200000,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.862 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":1,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":1,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199999,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.863 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":2,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":2,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199998,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.863 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":3,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":3,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199997,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.863 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":4,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":4,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199996,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.886 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.896 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":5,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":5,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199995,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.897 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":6,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":6,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199994,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.897 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":7,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":7,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199993,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.897 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":8,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":8,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199992,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.898 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":9,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":9,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199991,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.911 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.049 sec - in org.apache.arrow.vector.TestUnionVector Running org.apache.arrow.vector.pojo.TestConvert Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec - in org.apache.arrow.vector.pojo.TestConvert Running org.apache.arrow.vector.util.TestValidator Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec - in org.apache.arrow.vector.util.TestValidator ``` |
|
more details: Details``` Running org.apache.arrow.vector.stream.MessageSerializerTest 16:49:43.947 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.947 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 176 16:49:43.947 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.947 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 176 16:49:43.949 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.949 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.949 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.949 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.949 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.949 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.949 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.949 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.949 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.950 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156 16:49:43.950 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24 16:49:43.950 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.951 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.952 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.952 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 232 16:49:43.952 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.952 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 232 Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in org.apache.arrow.vector.stream.MessageSerializerTest Running org.apache.arrow.vector.TestDecimalVector 16:49:43.957 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors]. 16:49:43.958 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec - in org.apache.arrow.vector.TestDecimalVector Running org.apache.arrow.vector.TestVectorUnloadLoad 16:49:43.989 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - root 16:49:43.989 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.989 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.989 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.989 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.989 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.989 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.989 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.989 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.989 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.989 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.989 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - date 16:49:43.990 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 946684800000 16:49:43.990 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 981072000000 16:49:43.990 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1015113600000 16:49:43.991 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1049414400000 16:49:43.991 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1083715200000 16:49:43.991 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1118016000000 16:49:43.991 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1152230400000 16:49:43.991 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1186531200000 16:49:43.991 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1220918400000 16:49:43.991 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1255132800000 16:49:43.991 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - time 16:49:43.991 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 0 16:49:43.991 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 3661001 16:49:43.991 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 7322002 16:49:43.991 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 10983003 16:49:43.992 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 14644004 16:49:43.992 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 18305005 16:49:43.992 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 21966006 16:49:43.992 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 25627007 16:49:43.992 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 29288008 16:49:43.992 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 32949009 16:49:43.992 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - timestamp-milli 16:49:44.007 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2000-01-01T00:00:00.000+02:00 16:49:44.008 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2001-02-02T01:01:01.001+02:00 16:49:44.008 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2002-03-03T02:02:02.002+02:00 16:49:44.008 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2003-04-04T03:03:03.003+02:00 16:49:44.008 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2004-05-05T04:04:04.004+02:00 16:49:44.008 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2005-06-06T05:05:05.005+02:00 16:49:44.008 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2006-07-07T06:06:06.006+02:00 16:49:44.009 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2007-08-08T07:07:07.007+02:00 16:49:44.009 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2008-09-09T08:08:08.008+02:00 16:49:44.010 [main] DEBUG org.apache.arrow.vector.IntVector - Reallocating vector [$values$]. # of bytes: [16384] -> [32768] 16:49:44.011 [main] DEBUG org.apache.arrow.vector.BigIntVector - Reallocating vector [$values$]. # of bytes: [32768] -> [65536] 16:49:44.019 [main] DEBUG org.apache.arrow.vector.IntVector - Reallocating vector [$values$]. # of bytes: [32768] -> [65536] 16:49:44.014 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2009-10-10T09:09:09.009+02:00 16:49:44.020 [main] DEBUG org.apache.arrow.vector.BigIntVector - Reallocating vector [$values$]. # of bytes: [65536] -> [131072] 16:49:44.028 [threadDeathWatcher-1-1] DEBUG io.netty.buffer.PoolThreadCache - Freed 2 thread-local buffer(s) from thread: Thread-1 16:49:44.028 [threadDeathWatcher-1-1] DEBUG io.netty.buffer.PoolThreadCache - Freed 1 thread-local buffer(s) from thread: Thread-2 16:49:44.033 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors]. 16:49:44.039 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1250 16:49:44.039 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 1256, length: 40000 16:49:44.039 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 41256, length: 1250 16:49:44.040 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 42512, length: 80000 16:49:44.067 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[final vectors]. 16:49:44.072 [main] DEBUG o.a.a.vector.file.json.TestJSONFile - reading schema: Schema 16:49:44.076 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - date 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 946684800000 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 981072000000 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1015113600000 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1049414400000 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1083715200000 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1118016000000 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1152230400000 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1186531200000 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1220918400000 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1255132800000 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - time 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 0 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 3661001 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 7322002 16:49:44.078 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 10983003 16:49:44.078 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 14644004 16:49:44.078 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 18305005 16:49:44.078 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 21966006 16:49:44.078 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 25627007 16:49:44.078 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 29288008 16:49:44.078 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 32949009 16:49:44.078 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - timestamp-milli 16:49:44.078 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2000-01-01T00:00:00.000+02:00 16:49:44.078 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2001-02-02T01:01:01.001+02:00 16:49:44.078 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2002-03-03T02:02:02.002+02:00 16:49:44.079 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2003-04-04T03:03:03.003+02:00 16:49:44.079 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2004-05-05T04:04:04.004+02:00 16:49:44.079 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2005-06-06T05:05:05.005+02:00 16:49:44.079 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2006-07-07T06:06:06.006+02:00 16:49:44.079 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2007-08-08T07:07:07.007+02:00 16:49:44.079 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2008-09-09T08:08:08.008+02:00 16:49:44.079 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2009-10-10T09:09:09.009+02:00 16:49:44.081 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:44.081 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors]. 16:49:44.081 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.609 sec - in org.apache.arrow.vector.file.json.TestJSONFile Running org.apache.arrow.vector.types.pojo.TestSchema 16:49:44.101 [main] DEBUG org.apache.arrow.vector.IntVector - Reallocating vector [$values$]. # of bytes: [16384] -> [32768] 16:49:44.105 [main] DEBUG org.apache.arrow.vector.IntVector - Reallocating vector [$values$]. # of bytes: [32768] -> [65536] 16:49:44.108 [main] DEBUG org.apache.arrow.vector.UInt4Vector - Reallocating vector [$offsets$]. # of bytes: [16384] -> [32768] 16:49:44.114 [main] DEBUG org.apache.arrow.vector.IntVector - Reallocating vector [$values$]. # of bytes: [65536] -> [131072] 16:49:44.119 [main] DEBUG org.apache.arrow.vector.UInt4Vector - Reallocating vector [$offsets$]. # of bytes: [32768] -> [65536] 16:49:44.128 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1250 16:49:44.129 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 1256, length: 40004 16:49:44.129 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 41264, length: 3125 16:49:44.129 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 44392, length: 100000 16:49:44.163 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1280 16:49:44.164 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 1280, length: 40064 16:49:44.164 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 41344, length: 3136 16:49:44.167 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 44480, length: 100032 16:49:44.224 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[final vectors]. Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.138 sec - in org.apache.arrow.vector.types.pojo.TestSchema Running org.apache.arrow.vector.TestOversizedAllocationForValueVector 16:49:44.231 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors]. 16:49:44.234 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0 16:49:44.234 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 40 16:49:44.234 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 40, length: 0 16:49:44.234 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 40, length: 40 16:49:44.237 [main] DEBUG org.apache.arrow.vector.IntVector - Reallocating vector [$values$]. # of bytes: [16384] -> [32768] 16:49:44.238 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[final vectors]. 16:49:44.240 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.266 sec - in org.apache.arrow.vector.TestVectorUnloadLoad Running org.apache.arrow.vector.TestBitVector 16:49:44.245 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in org.apache.arrow.vector.TestBitVector Running org.apache.arrow.vector.TestListVector 16:49:44.249 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:44.251 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:44.264 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.038 sec - in org.apache.arrow.vector.TestOversizedAllocationForValueVector 16:49:44.277 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.029 sec - in org.apache.arrow.vector.TestListVectorResults : Tests run: 75, Failures: 0, Errors: 0, Skipped: 0 [INFO] T E S T ST E S T SRunning org.apache.arrow.tools.TestFileRoundtrip 16:49:48.224 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:48.283 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. testNestedDictionary(org.apache.arrow.tools.EchoServerTest) Time elapsed: 0.048 sec <<< ERROR! 16:49:48.297 [threadDeathWatcher-1-1] DEBUG io.netty.buffer.PoolThreadCache - Freed 3 thread-local buffer(s) from thread: Thread-1 testJSONRoundTripWithVariableWidth(org.apache.arrow.tools.TestIntegration) Time elapsed: 0.066 sec <<< FAILURE! Results : Failed tests: Tests in error: Tests run: 9, Failures: 2, Errors: 2, Skipped: 0 |
|
Ok, what is in that array on the C++ side? |
|
I'm guessing we need to relax that check, but if there's no valid data in there, what are we doing truncating it to be larger? Is there garbage there or does there need to be something? |
|
The array in C++ is going to have an offsets array of length 1 with a single 0 as a value https://github.com/apache/arrow/blob/master/cpp/src/arrow/ipc/json-internal.cc#L978 |
|
Ok, what's the semantic meaning of that 0? I will go start reading the spec but if you can give me a leg up that would be helpful. |
|
As in, what should the Java code be doing with that value? |
|
From the docs:
In this case it looks like the length is only 4 bytes, which I think violates that? |
|
Sorry you were talking about the offsets vector, not the nullability vector. My mistake. |
|
Ok, according to the |
|
It seems maybe the issue is that Java is ignoring the 0 for length 0. Having a single 0 (or any value) is correct, though, per the spec |
|
Ok, I have dug around and cannot figure out what would need to change to get the Java code to accept this truncation. I hope @julienledem or @jacques-n can take a look soon and make good use of the debugging I've done so far and spot what needs to change easily. If either of you want more info from me let me know, I am putting this on the back burner for now though, I don't plan to look at it any more until I hear more. If you can point me to what needs to change though, I can do the change and do the work of testing it. |
|
I think I figured out the problem, there's bugs both in C++ and Java. Will update patch with fix if I can get the respective test suites and integration tests passing |
There was a problem hiding this comment.
Here was the thing I'm not sure about. There's another place in the codebase where the offsets are nixed if the length is 0
There was a problem hiding this comment.
hmm. I'm not sure. @StevenMPhillips or @jacques-n might know better.
There was a problem hiding this comment.
OK. I don't think this does any harm, but if there's a more appropriate fix it would be good to do that (there was another place where length-0 was being special-cased already)
There was a problem hiding this comment.
We need a better way to signal EOS than a length-0 record batch (which is ambiguous)
|
@elahrvivaz would you mind also having a look at this? Thanks |
|
reader changes look good to me. I agree there should be a different way to indicate EOS - maybe changing to -1 would be minimally disruptive. |
|
I think true/false is a bit more clear than -1 (and better than void in any case). I'll wait for @julienledem or @jacques-n to comment on the loader change |
|
oh, yeah I meant in the actual file format. Current we write a 4-byte zero at the end of the stream - we could change it to a -1 |
|
Rebased |
|
@elahrvivaz the binary format itself is not an issue -- it's the Java code signaling that it's done. Before this patch, if you found a record batch with 0 rows in the middle of a stream, various code was incorrectly halting thinking the stream is finished. |
|
@wesm I'm thinking of the check for |
|
The build is passing except for the persistent S3 timeouts. I opened conda/conda#5032 |
Suppose you requested a dataset with a set of predicates that result in all of the data being filtered out. The server could send a null message, but returning record batch metadata with length 0 seems okay, too. Disallowing length-0 record batches seems like it might be a source of bugs (there are multiple patches open now concerning size-0 objects) |
|
I agree the system needs to provide a way to represent a zero-length, but valid, record batch. Trying to piggyback that on "null" is bound to lead to problems. |
|
@julienledem could you review the Java changes here? Thanks |
|
@julienledem ping on this one. |
|
I'd actually suggest against allowing zero length record batches entirely. I've found them to be a nuisance in my work and we make sure that they are not passed on in our work on top of arrow |
|
@jacques-n that seems like an application-level concern, though. If you're writing a file or stream, and you don't want to deal with them, don't write them. At least on the Python side, we regularly deal with 0-length DataFrames, so if that's what you have and want to accurately transmit to another party, then writing a 0-length batch is probably the right thing. Otherwise, the client/receiver must be able to disambiguate between "no data" and "length-0 data". I agree that length-0 things are annoying. |
…h record batches * Relax n + 1 restruction for 0-length vectors
|
Just rebased so maybe we'l get a passing build after ARROW-646 is in |
|
Is this OK to go in? |
julienledem
left a comment
There was a problem hiding this comment.
Overall this looks fine to me. Just made some comments that can be done later.
| for (ArrowBlock rbBlock : arrowReader.getRecordBlocks()) { | ||
| arrowReader.loadRecordBatch(rbBlock); | ||
| if (!arrowReader.loadRecordBatch(rbBlock)) { | ||
| throw new IOException("Expected to load record batch"); |
| ArrowBlock rbBlock = iterator.next(); | ||
| arrowReader.loadRecordBatch(rbBlock); | ||
| if (!arrowReader.loadRecordBatch(rbBlock)) { | ||
| throw new IOException("Expected to load record batch"); |
| .getFieldVectors().get(0); | ||
| for (int i = 0; i < batches; i++) { | ||
| reader.loadNextBatch(); | ||
| Assert.assertTrue(reader.loadNextBatch()); |
There was a problem hiding this comment.
add message with i for example
| } | ||
| } | ||
| reader.loadNextBatch(); | ||
| Assert.assertFalse(reader.loadNextBatch()); |
There was a problem hiding this comment.
hmm. I'm not sure. @StevenMPhillips or @jacques-n might know better.
|
|
||
| for (int n = 0; n < 2; n++) { | ||
| arrowReader.loadNextBatch(); | ||
| Assert.assertTrue(arrowReader.loadNextBatch()); |
There was a problem hiding this comment.
add message with i in it (see bellow)
@StevenMPhillips @nongli @julienledem I found a number of issues in both C++ and Java around the handling of 0-length vectors. It seems that preserving a single inconsequential offset for a length-0 variable length vector can be a bit difficult, so I relaxed a restruction in `loadFieldVectors` about this. Let me know if there's anything concerning about the other changes around EOS signaling Author: Wes McKinney <wes.mckinney@twosigma.com> Closes apache#505 from wesm/ARROW-783 and squashes the following commits: 28ddcab [Wes McKinney] * Have loadNextBatch return true/false for EOS to accommodate 0-length record batches * Relax n + 1 restruction for 0-length vectors
Bumps [org.assertj:assertj-core](https://github.com/assertj/assertj) from 3.26.3 to 3.27.2. Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@StevenMPhillips @nongli @julienledem I found a number of issues in both C++ and Java around the handling of 0-length vectors. It seems that preserving a single inconsequential offset for a length-0 variable length vector can be a bit difficult, so I relaxed a restruction in
loadFieldVectorsabout this. Let me know if there's anything concerning about the other changes around EOS signaling