Skip to content

ARROW-783: [Java/C++] Fixes for 0-length record batches#505

Closed
wesm wants to merge 1 commit intoapache:masterfrom
wesm:ARROW-783
Closed

ARROW-783: [Java/C++] Fixes for 0-length record batches#505
wesm wants to merge 1 commit intoapache:masterfrom
wesm:ARROW-783

Conversation

@wesm
Copy link
Copy Markdown
Member

@wesm wesm commented Apr 7, 2017

@StevenMPhillips @nongli @julienledem I found a number of issues in both C++ and Java around the handling of 0-length vectors. It seems that preserving a single inconsequential offset for a length-0 variable length vector can be a bit difficult, so I relaxed a restruction in loadFieldVectors about this. Let me know if there's anything concerning about the other changes around EOS signaling

@wesm
Copy link
Copy Markdown
Member Author

wesm commented Apr 7, 2017

@jacques-n @julienledem this breaks Java with the below. any chance this is related to ARROW-703?

23:28:53.455 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.cacheTrimInterval: 8192
23:28:53.470 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
23:28:53.471 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 2540
23:28:53.677 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
23:28:53.677 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 1828
23:28:53.677 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 0
23:28:53.680 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.680 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.680 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.680 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.680 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.680 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.680 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.681 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.681 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.681 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.681 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.681 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.681 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.681 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.681 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.681 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.682 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.682 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.682 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.682 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.682 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.682 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.682 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.682 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.682 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.682 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.682 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.682 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.682 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.683 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.683 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.683 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.683 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.683 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.683 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.683 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.683 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.683 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.683 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.683 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.684 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.684 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.684 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.684 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.684 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.684 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.684 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.684 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.684 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.684 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.684 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.684 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.684 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.684 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.685 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
23:28:53.685 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0
Exception in thread "main" java.lang.IllegalArgumentException: Could not load buffers for field binary_nullable: Binary. error message: can not truncate buffer to a larger size 4: 0
	at org.apache.arrow.vector.VectorLoader.loadBuffers(VectorLoader.java:82)
	at org.apache.arrow.vector.VectorLoader.load(VectorLoader.java:61)
	at org.apache.arrow.vector.file.ArrowReader$1.visit(ArrowReader.java:103)
	at org.apache.arrow.vector.file.ArrowReader$1.visit(ArrowReader.java:95)
	at org.apache.arrow.vector.schema.ArrowRecordBatch.accepts(ArrowRecordBatch.java:118)
	at org.apache.arrow.vector.file.ArrowReader.loadNextBatch(ArrowReader.java:109)
	at org.apache.arrow.tools.StreamToFile.convert(StreamToFile.java:44)
	at org.apache.arrow.tools.StreamToFile.main(StreamToFile.java:63)
Caused by: java.lang.IllegalArgumentException: can not truncate buffer to a larger size 4: 0
	at org.apache.arrow.vector.BaseDataValueVector.truncateBufferBasedOnSize(BaseDataValueVector.java:51)
	at org.apache.arrow.vector.NullableVarBinaryVector.loadFieldBuffers(NullableVarBinaryVector.java:151)
	at org.apache.arrow.vector.VectorLoader.loadBuffers(VectorLoader.java:79)
	... 7 more

@wesm
Copy link
Copy Markdown
Member Author

wesm commented Apr 7, 2017

@wesm
Copy link
Copy Markdown
Member Author

wesm commented Apr 7, 2017

FWIW, I rebased this branch on #428 and what's fixed there seems unrelated

@leifwalsh
Copy link
Copy Markdown
Contributor

I have reproduced this and have it in a debugger. It appears that the problem is that we are trying to truncate a buffer which has had 0 bytes written to it to size 4, which truncateBufferBasedOnSize doesn't like.

We're doing this because NullableVarBinaryVector wants to truncate it to length + 1 elements, for some reason, here. @julienledem @jacques-n do you know why we're adding 1 here in the variable length case? I don't understand this.

@wesm
Copy link
Copy Markdown
Member Author

wesm commented Apr 7, 2017

The offsets vector is 1 more than the length of the array, so for length 0, you probably still want 1 element, even if it's a zero. If you see in the JSON, the offsets vector has one element even

https://gist.github.com/wesm/92e90c7fffe0ee10014b40e51c2a2bf2#file-failing_data-json-L1061

@leifwalsh
Copy link
Copy Markdown
Contributor

leifwalsh commented Apr 7, 2017

If I remove the + 1 I get the following errors during the java build:

Details ``` ------------------------------------------------------- T E S T S ------------------------------------------------------- Running org.apache.arrow.vector.TestValueVector Running org.apache.arrow.vector.TestDictionaryVector 16:49:41.744 [main] DEBUG i.n.u.i.l.InternalLoggerFactory - Using SLF4J as the default logging framework 16:49:41.750 [main] DEBUG io.netty.buffer.AbstractByteBuf - -Dio.netty.buffer.bytebuf.checkAccessible: true 16:49:41.754 [main] DEBUG io.netty.util.ResourceLeakDetector - -Dio.netty.leakDetection.level: simple 16:49:41.755 [main] DEBUG io.netty.util.ResourceLeakDetector - -Dio.netty.leakDetection.maxRecords: 4 16:49:41.779 [main] DEBUG i.n.util.internal.PlatformDependent0 - java.nio.Buffer.address: available 16:49:41.780 [main] DEBUG i.n.util.internal.PlatformDependent0 - sun.misc.Unsafe.theUnsafe: available 16:49:41.783 [main] DEBUG i.n.util.internal.PlatformDependent0 - sun.misc.Unsafe.copyMemory: available 16:49:41.784 [main] DEBUG i.n.util.internal.PlatformDependent0 - direct buffer constructor: available 16:49:41.786 [main] DEBUG i.n.util.internal.PlatformDependent0 - java.nio.Bits.unaligned: available, true 16:49:41.787 [main] DEBUG i.n.util.internal.PlatformDependent0 - java.nio.DirectByteBuffer.(long, int): available 16:49:41.788 [main] DEBUG io.netty.util.internal.Cleaner0 - java.nio.ByteBuffer.cleaner(): available 16:49:41.791 [main] DEBUG i.n.util.internal.PlatformDependent - Java version: 8 16:49:41.791 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.noUnsafe: false 16:49:41.791 [main] DEBUG i.n.util.internal.PlatformDependent - sun.misc.Unsafe: available 16:49:41.792 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.noJavassist: false 16:49:41.797 [main] DEBUG i.n.util.internal.PlatformDependent - Javassist: unavailable 16:49:41.797 [main] DEBUG i.n.util.internal.PlatformDependent - You don't have Javassist in your class path or you don't have enough permission to load dynamically generated classes. Please check the configuration for better performance. 16:49:41.797 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.tmpdir: /home/leif/git/arrow/java/vector/target (java.io.tmpdir) 16:49:41.797 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.bitMode: 64 (sun.arch.data.model) 16:49:41.797 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.noPreferDirect: false 16:49:41.798 [main] DEBUG i.n.util.internal.PlatformDependent - io.netty.maxDirectMemory: 1836580864 bytes 16:49:41.798 [main] DEBUG i.n.util.ResourceLeakDetectorFactory - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@cb5822 16:49:41.803 [main] DEBUG i.n.u.i.l.InternalLoggerFactory - Using SLF4J as the default logging framework 16:49:41.815 [main] DEBUG io.netty.buffer.AbstractByteBuf - -Dio.netty.buffer.bytebuf.checkAccessible: true 16:49:41.821 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.numHeapArenas: 8 16:49:41.821 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.numDirectArenas: 8 16:49:41.822 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.pageSize: 8192 16:49:41.822 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.maxOrder: 11 16:49:41.822 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.chunkSize: 16777216 16:49:41.822 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.tinyCacheSize: 512 16:49:41.823 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.smallCacheSize: 256 16:49:41.823 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.normalCacheSize: 64 16:49:41.824 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 16:49:41.824 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.cacheTrimInterval: 8192 16:49:41.821 [main] DEBUG io.netty.util.ResourceLeakDetector - -Dio.netty.leakDetection.level: simple 16:49:41.826 [main] DEBUG io.netty.util.ResourceLeakDetector - -Dio.netty.leakDetection.maxRecords: 4 16:49:41.871 [main] DEBUG i.n.util.internal.PlatformDependent0 - java.nio.Buffer.address: available 16:49:41.875 [main] DEBUG i.n.util.internal.PlatformDependent0 - sun.misc.Unsafe.theUnsafe: available 16:49:41.878 [main] DEBUG i.n.util.internal.PlatformDependent0 - sun.misc.Unsafe.copyMemory: available 16:49:41.879 [main] DEBUG i.n.util.internal.PlatformDependent0 - direct buffer constructor: available 16:49:41.881 [main] DEBUG i.n.util.internal.PlatformDependent0 - java.nio.Bits.unaligned: available, true 16:49:41.881 [main] DEBUG i.n.util.internal.PlatformDependent0 - java.nio.DirectByteBuffer.(long, int): available 16:49:41.883 [main] DEBUG io.netty.util.internal.Cleaner0 - java.nio.ByteBuffer.cleaner(): available 16:49:41.884 [main] DEBUG i.n.util.internal.PlatformDependent - Java version: 8 16:49:41.884 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.noUnsafe: false 16:49:41.885 [main] DEBUG i.n.util.internal.PlatformDependent - sun.misc.Unsafe: available 16:49:41.885 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.noJavassist: false 16:49:41.887 [main] DEBUG i.n.util.internal.PlatformDependent - Javassist: unavailable 16:49:41.887 [main] DEBUG i.n.util.internal.PlatformDependent - You don't have Javassist in your class path or you don't have enough permission to load dynamically generated classes. Please check the configuration for better performance. 16:49:41.888 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.tmpdir: /home/leif/git/arrow/java/vector/target (java.io.tmpdir) 16:49:41.888 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.bitMode: 64 (sun.arch.data.model) 16:49:41.888 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.noPreferDirect: false 16:49:41.889 [main] DEBUG i.n.util.internal.PlatformDependent - io.netty.maxDirectMemory: 1836580864 bytes 16:49:41.890 [main] DEBUG i.n.util.ResourceLeakDetectorFactory - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@cb5822 16:49:41.911 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.numHeapArenas: 8 16:49:41.911 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.numDirectArenas: 8 16:49:41.911 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.pageSize: 8192 16:49:41.912 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.maxOrder: 11 16:49:41.912 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.chunkSize: 16777216 16:49:41.912 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.tinyCacheSize: 512 16:49:41.912 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.smallCacheSize: 256 16:49:41.913 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.normalCacheSize: 64 16:49:41.913 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 16:49:41.913 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.cacheTrimInterval: 8192 16:49:42.007 [main] DEBUG io.netty.util.Recycler - -Dio.netty.recycler.maxCapacity.default: 32768 16:49:42.007 [main] DEBUG io.netty.util.Recycler - -Dio.netty.recycler.maxSharedCapacityFactor: 2 16:49:42.007 [main] DEBUG io.netty.util.Recycler - -Dio.netty.recycler.linkCapacity: 16 16:49:42.007 [main] DEBUG io.netty.util.Recycler - -Dio.netty.recycler.ratio: 8 16:49:42.013 [main] DEBUG i.n.util.internal.PlatformDependent - org.jctools-core.MpscChunkedArrayQueue: available 16:49:42.031 [main] DEBUG org.apache.arrow.vector.Float4Vector - Reallocating vector [$values$]. # of bytes: [4096] -> [8192] 16:49:42.047 [main] DEBUG org.apache.arrow.vector.Float4Vector - Reallocating vector [$values$]. # of bytes: [8192] -> [16384] 16:49:42.060 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:42.089 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:42.098 [main] DEBUG io.netty.util.Recycler - -Dio.netty.recycler.maxCapacity.default: 32768 16:49:42.098 [main] DEBUG io.netty.util.Recycler - -Dio.netty.recycler.maxSharedCapacityFactor: 2 16:49:42.098 [main] DEBUG io.netty.util.Recycler - -Dio.netty.recycler.linkCapacity: 16 16:49:42.098 [main] DEBUG io.netty.util.Recycler - -Dio.netty.recycler.ratio: 8 16:49:42.104 [main] DEBUG i.n.util.internal.PlatformDependent - org.jctools-core.MpscChunkedArrayQueue: available 16:49:42.108 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:42.121 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:42.133 [main] DEBUG org.apache.arrow.vector.UInt4Vector - Reallocating vector [$offsets$]. # of bytes: [16] -> [32] 16:49:42.166 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:42.180 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.315 sec - in org.apache.arrow.vector.TestDictionaryVector Running org.apache.arrow.vector.complex.impl.TestPromotableWriter 16:49:42.326 [main] DEBUG o.a.a.v.c.AbstractContainerVector - Field [A] mutated from [NullableBitVector] to [UnionVector] 16:49:42.390 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:42.397 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:42.402 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:42.403 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.198 sec - in org.apache.arrow.vector.complex.impl.TestPromotableWriter Running org.apache.arrow.vector.complex.writer.TestComplexWriter 16:49:42.418 [main] DEBUG org.apache.arrow.vector.UInt4Vector - Reallocating vector [$offsets$]. # of bytes: [16384] -> [32768] 16:49:42.422 [main] DEBUG org.apache.arrow.vector.UInt4Vector - Reallocating vector [$offsets$]. # of bytes: [32768] -> [65536] 16:49:42.426 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.601 sec - in org.apache.arrow.vector.TestValueVector Running org.apache.arrow.vector.file.TestArrowFile 16:49:42.545 [main] DEBUG o.a.a.v.c.AbstractContainerVector - Field [a] mutated from [NullableBigIntVector] to [UnionVector] 16:49:42.685 [main] DEBUG org.apache.arrow.vector.UInt1Vector - Reallocating vector [types]. # of bytes: [4096] -> [8192] 16:49:42.893 [main] DEBUG org.apache.arrow.vector.UInt1Vector - Reallocating vector [types]. # of bytes: [4096] -> [8192] 16:49:42.917 [main] DEBUG o.a.a.v.c.AbstractContainerVector - Field [a] mutated from [NullableBigIntVector] to [UnionVector] 16:49:42.926 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:42.927 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:42.927 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 9 16:49:42.929 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:42.929 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:42.930 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 9 16:49:42.932 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - writing schema: Schema 16:49:42.932 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:42.953 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:42.953 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 232 16:49:42.955 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:42.955 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 208 16:49:42.962 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:42.962 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:42.962 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:42.962 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:42.962 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 9 16:49:42.963 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - DictionaryRecordBatch at 242, metadata: 214, body: 41 16:49:42.964 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:42.964 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 232 16:49:42.965 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:42.965 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 208 16:49:42.965 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:42.965 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:42.965 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:42.965 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 9 16:49:42.965 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - DictionaryRecordBatch at 236, metadata: 212, body: 41 16:49:42.966 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:42.966 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 24 16:49:42.966 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:42.967 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:42.967 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 3 16:49:42.967 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:42.967 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:42.967 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 24 16:49:42.969 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 489, metadata: 159, body: 32 16:49:42.975 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:42.975 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 24 16:49:42.977 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:42.977 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:42.977 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 3 16:49:42.977 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:42.977 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:42.977 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 24 16:49:42.981 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 481, metadata: 159, body: 32 16:49:42.981 [main] DEBUG org.apache.arrow.vector.UInt1Vector - Reallocating vector [types]. # of bytes: [4096] -> [8192] 16:49:42.984 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 304 16:49:42.984 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:42.985 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 680, length: 304 16:49:42.985 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:42.985 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 994 16:49:42.985 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:42.987 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors]. 16:49:42.990 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10 16:49:42.990 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 680, length: 304 16:49:42.990 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 304 16:49:42.994 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema 16:49:42.995 [main] DEBUG o.a.a.vector.file.ArrowFileReader - DictionaryRecordBatch at 242, metadata: 214, body: 41 16:49:42.996 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 255 16:49:42.998 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:42.999 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:42.999 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 9 16:49:43.001 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 489, metadata: 159, body: 32 16:49:43.005 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 191 16:49:43.007 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.008 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 24 16:49:43.019 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.020 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.020 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 232 16:49:43.020 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema 16:49:43.020 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.020 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 208 16:49:43.023 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 33 16:49:43.024 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.024 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.024 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 9 16:49:43.025 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.025 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 155 16:49:43.026 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 32 16:49:43.026 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.027 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 24 16:49:43.033 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.033 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.059 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.063 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 12 16:49:43.063 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 6 16:49:43.064 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.065 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 12 16:49:43.069 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 6 16:49:43.069 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - writing schema: Schema> 16:49:43.069 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.071 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.071 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 328 16:49:43.072 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.072 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 208 16:49:43.072 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.072 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:43.072 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:43.072 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 12 16:49:43.072 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.072 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.073 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - DictionaryRecordBatch at 338, metadata: 214, body: 38 16:49:43.075 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.075 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 328 16:49:43.076 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.076 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 208 16:49:43.076 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:43.076 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:43.076 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 12 16:49:43.076 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.076 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.076 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - DictionaryRecordBatch at 332, metadata: 212, body: 38 16:49:43.078 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.078 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.078 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 1 16:49:43.078 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 32, length: 16 16:49:43.079 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.079 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216 16:49:43.079 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.079 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:43.079 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:43.079 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.079 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:43.079 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:43.080 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.080 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 582, metadata: 226, body: 48 16:49:43.081 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.081 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.081 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 1 16:49:43.082 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 32, length: 16 16:49:43.082 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.082 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216 16:49:43.082 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.082 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:43.083 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:43.083 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.083 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:43.083 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:43.084 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.084 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 574, metadata: 226, body: 48 16:49:43.086 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 400 16:49:43.086 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.086 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 856, length: 400 16:49:43.088 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.088 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 1266 16:49:43.088 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.092 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10 16:49:43.092 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 856, length: 400 16:49:43.092 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 400 16:49:43.095 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema> 16:49:43.095 [main] DEBUG o.a.a.vector.file.ArrowFileReader - DictionaryRecordBatch at 338, metadata: 214, body: 38 16:49:43.096 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 252 16:49:43.098 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.098 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 12 16:49:43.098 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 6 16:49:43.100 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 582, metadata: 226, body: 48 16:49:43.107 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 274 16:49:43.111 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.111 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.111 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 1 16:49:43.112 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 32, length: 16 16:49:43.134 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.135 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.135 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 328 16:49:43.136 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema> 16:49:43.136 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.137 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 208 16:49:43.137 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 30 16:49:43.139 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.139 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 12 16:49:43.139 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 6 16:49:43.141 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.141 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 222 16:49:43.142 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 48 16:49:43.144 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.148 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.151 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 1 16:49:43.152 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 32, length: 16 16:49:43.156 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.156 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.209 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - writing schema: Schema 16:49:43.210 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.213 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.213 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 252 16:49:43.213 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.214 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.214 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.214 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.214 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.214 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216 16:49:43.214 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.215 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.215 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.215 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.215 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.215 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.215 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.215 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 262, metadata: 226, body: 136 Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.803 sec - in org.apache.arrow.vector.complex.writer.TestComplexWriter 16:49:43.216 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 296 16:49:43.216 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.216 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 624, length: 296 16:49:43.216 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.216 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 930 16:49:43.216 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.216 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 252 16:49:43.217 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.217 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.217 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.217 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.217 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.217 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216 16:49:43.218 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.218 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.218 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.218 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.218 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.218 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.218 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.218 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 256, metadata: 224, body: 136 16:49:43.218 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 Running org.apache.arrow.vector.file.TestArrowFooter 16:49:43.236 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors]. 16:49:43.237 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.248 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - writing schema: Schema 16:49:43.249 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.249 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.249 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 176 16:49:43.249 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.249 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.250 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.250 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.250 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.250 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.250 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.250 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.250 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 186, metadata: 158, body: 24 16:49:43.250 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 224 16:49:43.250 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.251 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 368, length: 224 16:49:43.251 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.251 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 602 16:49:43.251 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.251 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 176 16:49:43.251 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.251 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.252 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.252 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.252 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.252 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.252 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.252 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 180, metadata: 156, body: 24 16:49:43.252 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.253 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10 16:49:43.254 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 368, length: 224 16:49:43.254 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 224 16:49:43.254 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema 16:49:43.254 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 186, metadata: 158, body: 24 16:49:43.255 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 182 16:49:43.256 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.256 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.258 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[fileReader]. 16:49:43.258 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.258 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 176 16:49:43.258 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema 16:49:43.258 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.258 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 152 16:49:43.259 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24 16:49:43.259 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.259 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.260 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[streamReader]. 16:49:43.261 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.292 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - writing schema: Schema, map: Struct not null> 16:49:43.292 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.293 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.293 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 612 16:49:43.295 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.295 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.295 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.295 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.295 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 136, length: 2 16:49:43.295 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 144, length: 44 16:49:43.296 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 192, length: 2 16:49:43.296 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 200, length: 40 16:49:43.296 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 240, length: 27 16:49:43.296 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 272, length: 2 16:49:43.296 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 280, length: 2 16:49:43.296 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 288, length: 80 16:49:43.296 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.296 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 472 16:49:43.296 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.296 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 44 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 27 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 5 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.297 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.298 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.298 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.298 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 622, metadata: 482, body: 368 16:49:43.299 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 656 16:49:43.299 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.299 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 1472, length: 656 16:49:43.299 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.299 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 2138 16:49:43.300 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.300 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 612 16:49:43.301 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.301 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.301 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.301 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.301 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 136, length: 2 16:49:43.301 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 144, length: 44 16:49:43.302 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 192, length: 2 16:49:43.302 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 200, length: 40 16:49:43.302 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 240, length: 27 16:49:43.302 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 272, length: 2 16:49:43.302 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 280, length: 2 16:49:43.302 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 288, length: 80 16:49:43.303 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.307 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 472 16:49:43.308 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.308 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.308 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.309 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 44 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 27 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 5 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.310 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.311 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.311 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 616, metadata: 480, body: 368 16:49:43.312 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.315 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors]. 16:49:43.315 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10 16:49:43.315 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 1472, length: 656 16:49:43.315 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 656 16:49:43.316 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema, map: Struct not null> 16:49:43.316 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 622, metadata: 482, body: 368 16:49:43.317 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 850 16:49:43.321 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.321 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.322 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.322 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.322 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 136, length: 2 16:49:43.322 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 144, length: 44 16:49:43.322 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 192, length: 2 16:49:43.322 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 200, length: 40 16:49:43.323 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 240, length: 27 16:49:43.323 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 272, length: 2 16:49:43.323 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 280, length: 2 16:49:43.323 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 288, length: 80 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - int 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 0 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 4 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 5 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 6 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 7 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 9 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - bigInt 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 0 16:49:43.331 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1 16:49:43.332 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2 16:49:43.332 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 3 16:49:43.332 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 4 16:49:43.332 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 5 16:49:43.332 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 6 16:49:43.332 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 7 16:49:43.332 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 8 16:49:43.332 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 9 16:49:43.332 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - list 16:49:43.347 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.355 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.355 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.355 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.355 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.355 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.355 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.355 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.355 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.356 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.356 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - map Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.192 sec - in org.apache.arrow.vector.file.TestArrowFooter Running org.apache.arrow.vector.file.TestArrowReaderWriter 16:49:43.431 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.431 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.434 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.435 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.435 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.435 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.435 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.435 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.436 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 0, metadata: 160, body: 24 16:49:43.436 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.436 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.437 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 176 16:49:43.437 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 224 16:49:43.437 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.437 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 370, length: 224 16:49:43.437 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.437 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 604 16:49:43.441 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10 16:49:43.441 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 370, length: 224 16:49:43.441 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 224 16:49:43.442 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 0, metadata: 160, body: 24 16:49:43.443 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 184 16:49:43.445 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.445 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.032 sec - in org.apache.arrow.vector.file.TestArrowReaderWriter Running org.apache.arrow.vector.file.TestArrowStream 16:49:43.460 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.460 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 176 16:49:43.461 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.461 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.461 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.462 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.462 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.462 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.462 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.462 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 180, metadata: 156, body: 24 16:49:43.462 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.463 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.463 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 176 16:49:43.464 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.464 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 152 16:49:43.465 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24 16:49:43.466 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.466 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":0,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7200000,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.466 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.466 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":1,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":1,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199999,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.467 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":2,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":2,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199998,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.467 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.467 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":3,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":3,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199997,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.468 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":4,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":4,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199996,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.468 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.468 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":5,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":5,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199995,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.469 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":6,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":6,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199994,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.469 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.469 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 176 16:49:43.469 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.470 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.470 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 176 16:49:43.470 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.470 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.470 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":7,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":7,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199993,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.471 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.471 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":8,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":8,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199992,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.471 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":9,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":9,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199991,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.022 sec - in org.apache.arrow.vector.file.TestArrowStream Running org.apache.arrow.vector.file.json.TestJSONFile 16:49:43.476 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.477 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.477 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 612 16:49:43.478 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema, map: Struct not null> 16:49:43.478 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.478 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 476 16:49:43.479 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 368 16:49:43.482 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.482 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.482 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.483 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.483 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 136, length: 2 16:49:43.483 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 144, length: 44 16:49:43.483 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 192, length: 2 16:49:43.483 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 200, length: 40 16:49:43.484 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 240, length: 27 16:49:43.484 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 272, length: 2 16:49:43.484 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 280, length: 2 16:49:43.484 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 288, length: 80 16:49:43.490 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - int 16:49:43.490 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 0 16:49:43.490 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1 16:49:43.490 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 4 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 5 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 6 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 7 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 9 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - bigInt 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 0 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 3 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 4 16:49:43.491 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 5 16:49:43.492 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 6 16:49:43.492 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 7 16:49:43.492 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 8 16:49:43.492 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 9 16:49:43.492 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - list 16:49:43.492 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.492 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.492 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.492 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.493 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.493 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.493 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.493 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.493 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.493 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.493 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - map 16:49:43.494 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":0,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7200000,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.494 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":1,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":1,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199999,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.495 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":2,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":2,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199998,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.495 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":3,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":3,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199997,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.495 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":4,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":4,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199996,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.524 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":5,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":5,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199995,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.525 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":6,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":6,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199994,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.528 [main] DEBUG o.a.a.vector.file.json.TestJSONFile - reading schema: Schema> 16:49:43.526 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":7,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":7,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199993,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.526 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":8,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":8,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199992,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.526 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":9,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":9,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199991,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.529 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.529 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.538 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.538 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - writing schema: Schema 16:49:43.539 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.539 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.539 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.539 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 252 16:49:43.539 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.540 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.540 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.540 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.540 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.540 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216 16:49:43.540 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.540 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.540 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.541 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.541 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.541 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.541 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.541 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 262, metadata: 226, body: 136 16:49:43.542 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 296 16:49:43.542 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.542 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 624, length: 296 16:49:43.542 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.542 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 930 16:49:43.548 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.548 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 252 16:49:43.548 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.549 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.549 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.549 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.549 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.549 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216 16:49:43.549 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.549 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.549 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.549 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.549 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.549 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.549 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.549 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 256, metadata: 224, body: 136 16:49:43.550 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.551 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors]. 16:49:43.551 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10 16:49:43.552 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 624, length: 296 16:49:43.552 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 296 16:49:43.552 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema 16:49:43.552 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 262, metadata: 226, body: 136 16:49:43.553 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 362 16:49:43.555 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.556 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.556 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.556 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.559 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.559 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.559 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 252 16:49:43.560 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema 16:49:43.560 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.560 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 220 16:49:43.560 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 136 16:49:43.562 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.562 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.562 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.562 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.565 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.566 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.571 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.571 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.571 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 252 16:49:43.572 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.572 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 252 16:49:43.572 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.572 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.572 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.572 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.572 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.572 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216 16:49:43.572 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.572 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.573 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.573 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.573 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.573 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.573 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.573 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 262, metadata: 226, body: 136 16:49:43.573 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.573 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.573 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.573 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.574 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.574 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216 16:49:43.574 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.574 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.574 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.574 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.574 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.574 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.574 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.574 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 256, metadata: 224, body: 136 16:49:43.578 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.578 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 20 16:49:43.578 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 32, length: 1 16:49:43.578 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 40, length: 40 16:49:43.578 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.578 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216 16:49:43.578 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.578 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:43.578 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:43.578 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 20 16:49:43.578 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.579 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:43.579 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:43.579 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.579 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 624, metadata: 224, body: 80 16:49:43.580 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.580 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 20 16:49:43.580 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 32, length: 1 16:49:43.580 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 40, length: 40 16:49:43.580 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.581 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216 16:49:43.581 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.581 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:43.581 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:43.581 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 20 16:49:43.581 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.581 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:43.581 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:43.581 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.581 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 616, metadata: 224, body: 80 16:49:43.584 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 320 16:49:43.587 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.587 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 928, length: 320 16:49:43.587 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.587 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 1258 16:49:43.587 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.588 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors]. 16:49:43.589 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10 16:49:43.590 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 928, length: 320 16:49:43.590 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 320 16:49:43.590 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema 16:49:43.590 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 262, metadata: 226, body: 136 16:49:43.590 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 362 16:49:43.592 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.592 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.592 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.592 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.595 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 624, metadata: 224, body: 80 16:49:43.595 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 304 16:49:43.597 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.597 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 20 16:49:43.597 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 32, length: 1 16:49:43.597 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 40, length: 40 16:49:43.599 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.599 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.599 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 252 16:49:43.600 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema 16:49:43.600 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.600 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 220 16:49:43.600 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 136 16:49:43.601 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.601 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.601 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.601 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.604 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.604 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 220 16:49:43.604 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 80 16:49:43.606 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1 16:49:43.606 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 20 16:49:43.606 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 32, length: 1 16:49:43.606 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 40, length: 40 16:49:43.609 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.609 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.610 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - int 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 0 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 4 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 5 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 6 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 7 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 9 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - bigInt 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 0 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 3 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 4 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 5 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 6 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 7 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 8 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 9 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - list 16:49:43.619 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.620 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.620 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.620 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.620 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.620 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.620 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.620 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.620 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.620 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.620 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - map 16:49:43.621 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":0,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7200000,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.621 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":1,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":1,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199999,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.621 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":2,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":2,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199998,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.622 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":3,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":3,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199997,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.622 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":4,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":4,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199996,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.622 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":5,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":5,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199995,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.624 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":6,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":6,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199994,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.625 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":7,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":7,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199993,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.625 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":8,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":8,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199992,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.625 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"centuryOfEra":19,"secondOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":9,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"minuteOfDay":0,"millisOfDay":9,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199991,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.626 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - writing schema: Schema, map: Struct not null> 16:49:43.626 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.626 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.627 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 612 16:49:43.627 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.627 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.627 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.628 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.628 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 136, length: 2 16:49:43.628 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 144, length: 44 16:49:43.628 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 192, length: 2 16:49:43.628 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 200, length: 40 16:49:43.628 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 240, length: 27 16:49:43.629 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 272, length: 2 16:49:43.633 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors]. 16:49:43.633 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 280, length: 2 16:49:43.633 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 288, length: 80 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 472 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 44 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 27 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 5 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.634 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.635 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.635 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.635 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.635 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 622, metadata: 482, body: 368 16:49:43.636 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 656 16:49:43.637 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.637 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 1472, length: 656 16:49:43.637 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.637 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 2138 16:49:43.637 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.637 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 612 16:49:43.638 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.638 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40 16:49:43.638 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2 16:49:43.638 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80 16:49:43.638 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 136, length: 2 16:49:43.638 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 144, length: 44 16:49:43.638 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 192, length: 2 16:49:43.639 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 200, length: 40 16:49:43.639 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 240, length: 27 16:49:43.639 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 272, length: 2 16:49:43.639 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 280, length: 2 16:49:43.639 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 288, length: 80 16:49:43.639 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.639 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 472 16:49:43.639 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.639 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 44 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 27 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 5 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.640 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 616, metadata: 480, body: 368 16:49:43.641 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.643 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors]. 16:49:43.644 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.653 [main] DEBUG o.a.a.v.c.AbstractContainerVector - Field [union] mutated from [NullableIntVector] to [UnionVector] 16:49:43.653 [main] DEBUG o.a.a.vector.file.json.TestJSONFile - reading schema: Schema, map: Struct not null> 16:49:43.666 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - int 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 0 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 4 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 5 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 6 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 7 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 9 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - bigInt 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 0 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 3 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 4 16:49:43.667 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 5 16:49:43.668 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 6 16:49:43.668 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 7 16:49:43.668 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 8 16:49:43.668 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 9 16:49:43.668 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - list 16:49:43.671 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.676 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - writing schema: Schema, map: Struct not null>> 16:49:43.676 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.679 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.679 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.679 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.680 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.680 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.680 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 708 16:49:43.681 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 10 16:49:43.681 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 16, length: 2 16:49:43.681 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 40 16:49:43.681 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 64, length: 2 16:49:43.681 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.681 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 72, length: 80 16:49:43.681 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.682 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 152, length: 2 16:49:43.682 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 160, length: 44 16:49:43.682 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.682 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 208, length: 1 16:49:43.682 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 216, length: 12 16:49:43.682 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.682 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.682 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 232, length: 6 16:49:43.682 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - map 16:49:43.682 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 240, length: 2 16:49:43.688 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 248, length: 2 16:49:43.689 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 256, length: 80 16:49:43.689 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.689 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 512 16:49:43.689 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.689 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 10 16:49:43.689 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.689 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.689 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.689 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.689 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.695 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 44 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 12 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.696 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 718, metadata: 522, body: 336 16:49:43.698 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 752 16:49:43.698 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.698 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 1576, length: 752 16:49:43.698 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.698 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 2338 16:49:43.699 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.699 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 708 16:49:43.700 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 10 16:49:43.700 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 16, length: 2 16:49:43.700 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 40 16:49:43.700 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 64, length: 2 16:49:43.700 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 72, length: 80 16:49:43.700 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 152, length: 2 16:49:43.700 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 160, length: 44 16:49:43.701 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 208, length: 1 16:49:43.706 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 216, length: 12 16:49:43.707 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 232, length: 6 16:49:43.707 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 240, length: 2 16:49:43.707 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 248, length: 2 16:49:43.707 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 256, length: 80 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 512 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 10 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 44 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 12 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80 16:49:43.708 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 712, metadata: 520, body: 336 16:49:43.709 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.712 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors]. 16:49:43.712 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10 16:49:43.712 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 1576, length: 752 16:49:43.712 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 752 16:49:43.713 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema, map: Struct not null>> 16:49:43.713 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 718, metadata: 522, body: 336 16:49:43.713 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 858 16:49:43.716 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 10 16:49:43.717 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 16, length: 2 16:49:43.717 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 40 16:49:43.717 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 64, length: 2 16:49:43.717 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 72, length: 80 16:49:43.717 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 152, length: 2 16:49:43.717 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 160, length: 44 16:49:43.717 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 208, length: 1 16:49:43.718 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 216, length: 12 16:49:43.718 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 232, length: 6 16:49:43.718 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 240, length: 2 16:49:43.718 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 248, length: 2 16:49:43.718 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 256, length: 80 16:49:43.722 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":0,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7200000,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.722 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":1,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":1,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199999,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.723 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":2,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":2,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199998,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.723 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":3,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":3,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199997,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.723 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":4,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":4,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199996,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.724 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":5,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":5,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199995,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.724 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":6,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":6,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199994,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.725 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":7,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":7,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199993,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.726 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":8,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":8,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199992,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.726 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":9,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":9,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199991,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.730 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.730 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.733 [main] DEBUG o.a.a.v.c.AbstractContainerVector - Field [union] mutated from [NullableIntVector] to [UnionVector] 16:49:43.739 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - root 16:49:43.739 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.739 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.739 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.739 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.739 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.739 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.739 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.739 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.739 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.740 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.751 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.752 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.752 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 708 16:49:43.765 [main] DEBUG o.a.arrow.vector.file.TestArrowFile - reading schema: Schema, map: Struct not null>> 16:49:43.765 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.765 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 516 16:49:43.766 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 336 16:49:43.771 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 10 16:49:43.771 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 16, length: 2 16:49:43.771 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 40 16:49:43.771 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 64, length: 2 16:49:43.772 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 72, length: 80 16:49:43.772 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 152, length: 2 16:49:43.772 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 160, length: 44 16:49:43.772 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 208, length: 1 16:49:43.772 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 216, length: 12 16:49:43.772 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 232, length: 6 16:49:43.772 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 240, length: 2 16:49:43.772 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 248, length: 2 16:49:43.773 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 256, length: 80 16:49:43.783 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.784 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.348 sec - in org.apache.arrow.vector.file.TestArrowFile Running org.apache.arrow.vector.file.TestArrowStreamPipe 16:49:43.800 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors]. 16:49:43.811 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.811 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 176 16:49:43.813 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.813 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.813 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.813 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.813 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.814 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.814 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.814 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 180, metadata: 156, body: 24 16:49:43.814 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.815 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.815 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.815 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.815 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.815 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.815 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.815 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.815 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 360, metadata: 160, body: 24 16:49:43.816 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.816 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.816 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.816 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.816 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.816 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.816 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.816 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.816 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 544, metadata: 160, body: 24 16:49:43.817 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.818 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.819 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.819 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.819 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.819 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.823 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.823 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 176 16:49:43.824 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.824 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 152 16:49:43.824 [main] DEBUG o.a.a.vector.file.json.TestJSONFile - reading schema: Schema, map: Struct not null>> 16:49:43.824 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.824 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.824 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 728, metadata: 160, body: 24 16:49:43.825 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24 16:49:43.825 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.825 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.826 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.826 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.826 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.826 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.826 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.826 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.826 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 912, metadata: 160, body: 24 16:49:43.827 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.827 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.827 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.827 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.827 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.827 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.827 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.827 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.827 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 1096, metadata: 160, body: 24 16:49:43.828 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.828 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.828 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.828 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.828 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.828 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.828 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.828 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.828 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.828 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.828 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 1280, metadata: 160, body: 24 16:49:43.828 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.828 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156 16:49:43.829 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24 16:49:43.829 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.829 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.830 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.838 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156 16:49:43.838 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24 16:49:43.839 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.839 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.841 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[final vectors]. 16:49:43.841 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:43.833 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.841 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.841 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.841 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.841 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156 16:49:43.841 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.841 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.841 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.841 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.841 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.841 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 1464, metadata: 160, body: 24 16:49:43.841 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.842 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24 16:49:43.842 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.842 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.843 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.843 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.843 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.843 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156 16:49:43.843 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.843 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.843 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.843 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.843 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.843 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.843 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 1648, metadata: 160, body: 24 16:49:43.844 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.844 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.844 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.844 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.844 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.844 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.844 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.844 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.844 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 1832, metadata: 160, body: 24 16:49:43.844 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.844 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24 16:49:43.845 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.845 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.846 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.846 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156 16:49:43.847 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24 16:49:43.847 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.847 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.848 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.848 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156 16:49:43.848 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24 16:49:43.849 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.849 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.849 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.850 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156 16:49:43.850 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24 16:49:43.850 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.850 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.851 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.851 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156 16:49:43.851 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24 16:49:43.852 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.852 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.852 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.853 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156 16:49:43.853 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24 16:49:43.853 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.853 [Thread-2] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.854 [Thread-2] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.858 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - int 16:49:43.858 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 0 16:49:43.858 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 4 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 5 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 6 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 7 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 9 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - bigInt 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 0 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 3 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 4 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 5 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 6 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 7 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 8 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 9 16:49:43.859 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - list 16:49:43.860 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.860 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.860 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.860 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.860 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.860 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.860 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.861 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc"] 16:49:43.861 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - ["abc","abc"] 16:49:43.861 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - [] 16:49:43.861 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - map Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.074 sec - in org.apache.arrow.vector.file.TestArrowStreamPipe Running org.apache.arrow.vector.TestUnionVector 16:49:43.861 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":0,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":0,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7200000,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.862 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":1,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":1,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199999,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.863 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":2,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":2,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199998,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.863 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":3,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":3,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199997,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.863 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":4,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":4,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199996,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.886 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:43.896 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":5,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":5,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199995,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.897 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":6,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":6,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199994,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.897 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":7,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":7,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199993,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.897 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":8,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":8,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199992,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.898 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - {"timestamp":{"era":1,"dayOfYear":1,"dayOfWeek":4,"dayOfMonth":1,"year":1970,"weekOfWeekyear":1,"millisOfDay":9,"monthOfYear":1,"hourOfDay":0,"minuteOfHour":0,"secondOfMinute":0,"millisOfSecond":9,"weekyear":1970,"yearOfEra":1970,"yearOfCentury":70,"centuryOfEra":19,"secondOfDay":0,"minuteOfDay":0,"zone":{"fixed":true,"id":"+02:00"},"millis":-7199991,"chronology":{"zone":{"fixed":true,"id":"+02:00"}},"afterNow":false,"beforeNow":true,"equalNow":false}} 16:49:43.911 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.049 sec - in org.apache.arrow.vector.TestUnionVector Running org.apache.arrow.vector.pojo.TestConvert Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec - in org.apache.arrow.vector.pojo.TestConvert Running org.apache.arrow.vector.util.TestValidator Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec - in org.apache.arrow.vector.util.TestValidator ```

@leifwalsh
Copy link
Copy Markdown
Contributor

more details:

Details ``` Running org.apache.arrow.vector.stream.MessageSerializerTest 16:49:43.947 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.947 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 176 16:49:43.947 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.947 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 176 16:49:43.949 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.949 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.949 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.949 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152 16:49:43.949 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.949 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2 16:49:43.949 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6 16:49:43.949 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16 16:49:43.949 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.950 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156 16:49:43.950 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24 16:49:43.950 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2 16:49:43.951 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16 16:49:43.952 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4 16:49:43.952 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 232 16:49:43.952 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4 16:49:43.952 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 232 Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in org.apache.arrow.vector.stream.MessageSerializerTest Running org.apache.arrow.vector.TestDecimalVector 16:49:43.957 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors]. 16:49:43.958 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec - in org.apache.arrow.vector.TestDecimalVector Running org.apache.arrow.vector.TestVectorUnloadLoad 16:49:43.989 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - root 16:49:43.989 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.989 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.989 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.989 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.989 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.989 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.989 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.989 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.989 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.989 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - null 16:49:43.989 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - date 16:49:43.990 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 946684800000 16:49:43.990 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 981072000000 16:49:43.990 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1015113600000 16:49:43.991 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1049414400000 16:49:43.991 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1083715200000 16:49:43.991 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1118016000000 16:49:43.991 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1152230400000 16:49:43.991 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1186531200000 16:49:43.991 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1220918400000 16:49:43.991 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1255132800000 16:49:43.991 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - time 16:49:43.991 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 0 16:49:43.991 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 3661001 16:49:43.991 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 7322002 16:49:43.991 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 10983003 16:49:43.992 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 14644004 16:49:43.992 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 18305005 16:49:43.992 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 21966006 16:49:43.992 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 25627007 16:49:43.992 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 29288008 16:49:43.992 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 32949009 16:49:43.992 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - timestamp-milli 16:49:44.007 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2000-01-01T00:00:00.000+02:00 16:49:44.008 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2001-02-02T01:01:01.001+02:00 16:49:44.008 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2002-03-03T02:02:02.002+02:00 16:49:44.008 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2003-04-04T03:03:03.003+02:00 16:49:44.008 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2004-05-05T04:04:04.004+02:00 16:49:44.008 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2005-06-06T05:05:05.005+02:00 16:49:44.008 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2006-07-07T06:06:06.006+02:00 16:49:44.009 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2007-08-08T07:07:07.007+02:00 16:49:44.009 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2008-09-09T08:08:08.008+02:00 16:49:44.010 [main] DEBUG org.apache.arrow.vector.IntVector - Reallocating vector [$values$]. # of bytes: [16384] -> [32768] 16:49:44.011 [main] DEBUG org.apache.arrow.vector.BigIntVector - Reallocating vector [$values$]. # of bytes: [32768] -> [65536] 16:49:44.019 [main] DEBUG org.apache.arrow.vector.IntVector - Reallocating vector [$values$]. # of bytes: [32768] -> [65536] 16:49:44.014 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2009-10-10T09:09:09.009+02:00 16:49:44.020 [main] DEBUG org.apache.arrow.vector.BigIntVector - Reallocating vector [$values$]. # of bytes: [65536] -> [131072] 16:49:44.028 [threadDeathWatcher-1-1] DEBUG io.netty.buffer.PoolThreadCache - Freed 2 thread-local buffer(s) from thread: Thread-1 16:49:44.028 [threadDeathWatcher-1-1] DEBUG io.netty.buffer.PoolThreadCache - Freed 1 thread-local buffer(s) from thread: Thread-2 16:49:44.033 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors]. 16:49:44.039 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1250 16:49:44.039 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 1256, length: 40000 16:49:44.039 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 41256, length: 1250 16:49:44.040 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 42512, length: 80000 16:49:44.067 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[final vectors]. 16:49:44.072 [main] DEBUG o.a.a.vector.file.json.TestJSONFile - reading schema: Schema 16:49:44.076 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - date 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 946684800000 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 981072000000 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1015113600000 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1049414400000 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1083715200000 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1118016000000 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1152230400000 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1186531200000 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1220918400000 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 1255132800000 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - time 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 0 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 3661001 16:49:44.077 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 7322002 16:49:44.078 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 10983003 16:49:44.078 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 14644004 16:49:44.078 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 18305005 16:49:44.078 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 21966006 16:49:44.078 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 25627007 16:49:44.078 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 29288008 16:49:44.078 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 32949009 16:49:44.078 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - timestamp-milli 16:49:44.078 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2000-01-01T00:00:00.000+02:00 16:49:44.078 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2001-02-02T01:01:01.001+02:00 16:49:44.078 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2002-03-03T02:02:02.002+02:00 16:49:44.079 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2003-04-04T03:03:03.003+02:00 16:49:44.079 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2004-05-05T04:04:04.004+02:00 16:49:44.079 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2005-06-06T05:05:05.005+02:00 16:49:44.079 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2006-07-07T06:06:06.006+02:00 16:49:44.079 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2007-08-08T07:07:07.007+02:00 16:49:44.079 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2008-09-09T08:08:08.008+02:00 16:49:44.079 [main] DEBUG o.a.arrow.vector.file.BaseFileTest - 2009-10-10T09:09:09.009+02:00 16:49:44.081 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader]. 16:49:44.081 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors]. 16:49:44.081 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.609 sec - in org.apache.arrow.vector.file.json.TestJSONFile Running org.apache.arrow.vector.types.pojo.TestSchema 16:49:44.101 [main] DEBUG org.apache.arrow.vector.IntVector - Reallocating vector [$values$]. # of bytes: [16384] -> [32768] 16:49:44.105 [main] DEBUG org.apache.arrow.vector.IntVector - Reallocating vector [$values$]. # of bytes: [32768] -> [65536] 16:49:44.108 [main] DEBUG org.apache.arrow.vector.UInt4Vector - Reallocating vector [$offsets$]. # of bytes: [16384] -> [32768] 16:49:44.114 [main] DEBUG org.apache.arrow.vector.IntVector - Reallocating vector [$values$]. # of bytes: [65536] -> [131072] 16:49:44.119 [main] DEBUG org.apache.arrow.vector.UInt4Vector - Reallocating vector [$offsets$]. # of bytes: [32768] -> [65536] 16:49:44.128 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1250 16:49:44.129 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 1256, length: 40004 16:49:44.129 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 41264, length: 3125 16:49:44.129 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 44392, length: 100000 16:49:44.163 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1280 16:49:44.164 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 1280, length: 40064 16:49:44.164 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 41344, length: 3136 16:49:44.167 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 44480, length: 100032 16:49:44.224 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[final vectors]. Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.138 sec - in org.apache.arrow.vector.types.pojo.TestSchema Running org.apache.arrow.vector.TestOversizedAllocationForValueVector 16:49:44.231 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors]. 16:49:44.234 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 0 16:49:44.234 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 40 16:49:44.234 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 40, length: 0 16:49:44.234 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 40, length: 40 16:49:44.237 [main] DEBUG org.apache.arrow.vector.IntVector - Reallocating vector [$values$]. # of bytes: [16384] -> [32768] 16:49:44.238 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[final vectors]. 16:49:44.240 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.266 sec - in org.apache.arrow.vector.TestVectorUnloadLoad Running org.apache.arrow.vector.TestBitVector 16:49:44.245 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in org.apache.arrow.vector.TestBitVector Running org.apache.arrow.vector.TestListVector 16:49:44.249 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:44.251 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. 16:49:44.264 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.038 sec - in org.apache.arrow.vector.TestOversizedAllocationForValueVector 16:49:44.277 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT]. Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.029 sec - in org.apache.arrow.vector.TestListVector

Results :

Tests run: 75, Failures: 0, Errors: 0, Skipped: 0

[INFO]
[INFO] --- maven-jar-plugin:3.0.0:jar (default-jar) @ arrow-vector ---
[INFO] Building jar: /home/leif/git/arrow/java/vector/target/arrow-vector-0.2.1-SNAPSHOT.jar
[INFO]
[INFO] --- maven-site-plugin:3.5.1:attach-descriptor (attach-descriptor) @ arrow-vector ---
[INFO]
[INFO] --- maven-jar-plugin:3.0.0:test-jar (default) @ arrow-vector ---
[INFO] Building jar: /home/leif/git/arrow/java/vector/target/arrow-vector-0.2.1-SNAPSHOT-tests.jar
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Arrow Tools 0.2.1-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- apache-rat-plugin:0.11:check (rat-checks) @ arrow-tools ---
[INFO] 51 implicit excludes (use -debug for more details).
[INFO] Exclude: **/.log
[INFO] Exclude: **/
.css
[INFO] Exclude: **/.js
[INFO] Exclude: **/
.md
[INFO] Exclude: **/.eps
[INFO] Exclude: **/
.json
[INFO] Exclude: **/.seq
[INFO] Exclude: **/
.parquet
[INFO] Exclude: **/.sql
[INFO] Exclude: **/git.properties
[INFO] Exclude: **/
.csv
[INFO] Exclude: **/.csvh
[INFO] Exclude: **/
.csvh-test
[INFO] Exclude: **/.tsv
[INFO] Exclude: **/
.txt
[INFO] Exclude: **/.ssv
[INFO] Exclude: **/arrow-
.conf
[INFO] Exclude: **/.buildpath
[INFO] Exclude: **/.proto
[INFO] Exclude: **/
.fmpp
[INFO] Exclude: /target/
[INFO] Exclude: **/.iml
[INFO] Exclude: **/
.tdd
[INFO] Exclude: **/.project
[INFO] Exclude: **/TAGS
[INFO] Exclude: **/
.checkstyle
[INFO] Exclude: /.classpath
[INFO] Exclude: /.settings/
[INFO] Exclude: .*/

[INFO] Exclude: **/.patch
[INFO] Exclude: **/
.pb.cc
[INFO] Exclude: **/.pb.h
[INFO] Exclude: **/
.linux
[INFO] Exclude: /client/build/
[INFO] Exclude: **/.tbl
[INFO] 10 resources included (use -debug for more details)
[INFO] Rat check: Summary of files. Unapproved: 0 unknown: 0 generated: 0 approved: 10 licence.
[INFO]
[INFO] --- maven-checkstyle-plugin:2.17:check (validate) @ arrow-tools ---
[INFO] Starting audit...
[WARN] /home/leif/git/arrow/java/tools/src/main/java/org/apache/arrow/tools/Integration.java:60:3: Missing a Javadoc comment. [JavadocMethod]
[WARN] /home/leif/git/arrow/java/tools/src/main/java/org/apache/arrow/tools/Integration.java:63:29: Catch parameter name 'e' must match pattern '^[a-z][a-z0-9][a-zA-Z0-9]
$'. [CatchParameterName]
[WARN] /home/leif/git/arrow/java/tools/src/main/java/org/apache/arrow/tools/Integration.java:65:26: Catch parameter name 'e' must match pattern '^[a-z][a-z0-9][a-zA-Z0-9]$'. [CatchParameterName]
[WARN] /home/leif/git/arrow/java/tools/src/main/java/org/apache/arrow/tools/Integration.java:67:31: Catch parameter name 'e' must match pattern '^[a-z][a-z0-9][a-zA-Z0-9]
$'. [CatchParameterName]
[WARN] /home/leif/git/arrow/java/tools/src/main/java/org/apache/arrow/tools/Integration.java:72:60: Parameter name 'e' must match pattern '^[a-z][a-z0-9][a-zA-Z0-9]$'. [ParameterName]
[WARN] /home/leif/git/arrow/java/tools/src/main/java/org/apache/arrow/tools/Integration.java:83:10: Local variable name 'f' must match pattern '^[a-z][a-z0-9][a-zA-Z0-9]
$'. [LocalVariableName]
[WARN] /home/leif/git/arrow/java/tools/src/main/java/org/apache/arrow/tools/Integration.java:107:39: Catch parameter name 'e' must match pattern '^[a-z][a-z0-9][a-zA-Z0-9]$'. [CatchParameterName]
[WARN] /home/leif/git/arrow/java/tools/src/main/java/org/apache/arrow/tools/Integration.java:188: Abbreviation in name 'hasMoreJSON' must contain no more than '1' capital letters. [AbbreviationAsWordInName]
[WARN] /home/leif/git/arrow/java/tools/src/main/java/org/apache/arrow/tools/Integration.java:206:14: 'public' modifier out of order with the JLS suggestions. [ModifierOrder]
[WARN] /home/leif/git/arrow/java/tools/src/main/java/org/apache/arrow/tools/FileToStream.java:39:3: Missing a Javadoc comment. [JavadocMethod]
[WARN] /home/leif/git/arrow/java/tools/src/main/java/org/apache/arrow/tools/FileToStream.java:56:3: Missing a Javadoc comment. [JavadocMethod]
[WARN] /home/leif/git/arrow/java/tools/src/main/java/org/apache/arrow/tools/FileToStream.java:63:41: '?' should be on a new line. [OperatorWrap]
[WARN] /home/leif/git/arrow/java/tools/src/main/java/org/apache/arrow/tools/StreamToFile.java:39:3: Missing a Javadoc comment. [JavadocMethod]
[WARN] /home/leif/git/arrow/java/tools/src/main/java/org/apache/arrow/tools/StreamToFile.java:56:3: Missing a Javadoc comment. [JavadocMethod]
[WARN] /home/leif/git/arrow/java/tools/src/main/java/org/apache/arrow/tools/FileRoundtrip.java:47: 'CTOR_DEF' should be separated from previous statement. [EmptyLineSeparator]
[WARN] /home/leif/git/arrow/java/tools/src/main/java/org/apache/arrow/tools/FileRoundtrip.java:64:10: Local variable name 'f' must match pattern '^[a-z][a-z0-9][a-zA-Z0-9]
$'. [LocalVariableName]
[WARN] /home/leif/git/arrow/java/tools/src/main/java/org/apache/arrow/tools/FileRoundtrip.java:108:29: Catch parameter name 'e' must match pattern '^[a-z][a-z0-9][a-zA-Z0-9]$'. [CatchParameterName]
[WARN] /home/leif/git/arrow/java/tools/src/main/java/org/apache/arrow/tools/FileRoundtrip.java:110:26: Catch parameter name 'e' must match pattern '^[a-z][a-z0-9][a-zA-Z0-9]
$'. [CatchParameterName]
[WARN] /home/leif/git/arrow/java/tools/src/main/java/org/apache/arrow/tools/FileRoundtrip.java:116:52: Parameter name 'e' must match pattern '^[a-z][a-z0-9][a-zA-Z0-9]$'. [ParameterName]
[WARN] /home/leif/git/arrow/java/tools/src/main/java/org/apache/arrow/tools/EchoServer.java:40:3: Missing a Javadoc comment. [JavadocMethod]
[WARN] /home/leif/git/arrow/java/tools/src/main/java/org/apache/arrow/tools/EchoServer.java:46:3: Missing a Javadoc comment. [JavadocMethod]
[WARN] /home/leif/git/arrow/java/tools/src/main/java/org/apache/arrow/tools/EchoServer.java:60:3: Missing a Javadoc comment. [JavadocMethod]
[WARN] /home/leif/git/arrow/java/tools/src/main/java/org/apache/arrow/tools/EchoServer.java:69:32: Catch parameter name 'e' must match pattern '^[a-z][a-z0-9][a-zA-Z0-9]
$'. [CatchParameterName]
[WARN] /home/leif/git/arrow/java/tools/src/main/java/org/apache/arrow/tools/EchoServer.java:76: 'if' construct must use '{}'s. [NeedBraces]
[WARN] /home/leif/git/arrow/java/tools/src/main/java/org/apache/arrow/tools/EchoServer.java:95:5: Missing a Javadoc comment. [JavadocMethod]
Audit done.
[WARNING] src/main/java/org/apache/arrow/tools/Integration.java:[60,3] (javadoc) JavadocMethod: Missing a Javadoc comment.
[WARNING] src/main/java/org/apache/arrow/tools/Integration.java:[63,29] (naming) CatchParameterName: Catch parameter name 'e' must match pattern '^[a-z][a-z0-9][a-zA-Z0-9]$'.
[WARNING] src/main/java/org/apache/arrow/tools/Integration.java:[65,26] (naming) CatchParameterName: Catch parameter name 'e' must match pattern '^[a-z][a-z0-9][a-zA-Z0-9]
$'.
[WARNING] src/main/java/org/apache/arrow/tools/Integration.java:[67,31] (naming) CatchParameterName: Catch parameter name 'e' must match pattern '^[a-z][a-z0-9][a-zA-Z0-9]$'.
[WARNING] src/main/java/org/apache/arrow/tools/Integration.java:[72,60] (naming) ParameterName: Parameter name 'e' must match pattern '^[a-z][a-z0-9][a-zA-Z0-9]
$'.
[WARNING] src/main/java/org/apache/arrow/tools/Integration.java:[83,10] (naming) LocalVariableName: Local variable name 'f' must match pattern '^[a-z][a-z0-9][a-zA-Z0-9]$'.
[WARNING] src/main/java/org/apache/arrow/tools/Integration.java:[107,39] (naming) CatchParameterName: Catch parameter name 'e' must match pattern '^[a-z][a-z0-9][a-zA-Z0-9]
$'.
[WARNING] src/main/java/org/apache/arrow/tools/Integration.java:[188] (naming) AbbreviationAsWordInName: Abbreviation in name 'hasMoreJSON' must contain no more than '1' capital letters.
[WARNING] src/main/java/org/apache/arrow/tools/Integration.java:[206,14] (modifier) ModifierOrder: 'public' modifier out of order with the JLS suggestions.
[WARNING] src/main/java/org/apache/arrow/tools/FileToStream.java:[39,3] (javadoc) JavadocMethod: Missing a Javadoc comment.
[WARNING] src/main/java/org/apache/arrow/tools/FileToStream.java:[56,3] (javadoc) JavadocMethod: Missing a Javadoc comment.
[WARNING] src/main/java/org/apache/arrow/tools/FileToStream.java:[63,41] (whitespace) OperatorWrap: '?' should be on a new line.
[WARNING] src/main/java/org/apache/arrow/tools/StreamToFile.java:[39,3] (javadoc) JavadocMethod: Missing a Javadoc comment.
[WARNING] src/main/java/org/apache/arrow/tools/StreamToFile.java:[56,3] (javadoc) JavadocMethod: Missing a Javadoc comment.
[WARNING] src/main/java/org/apache/arrow/tools/FileRoundtrip.java:[47] (whitespace) EmptyLineSeparator: 'CTOR_DEF' should be separated from previous statement.
[WARNING] src/main/java/org/apache/arrow/tools/FileRoundtrip.java:[64,10] (naming) LocalVariableName: Local variable name 'f' must match pattern '^[a-z][a-z0-9][a-zA-Z0-9]$'.
[WARNING] src/main/java/org/apache/arrow/tools/FileRoundtrip.java:[108,29] (naming) CatchParameterName: Catch parameter name 'e' must match pattern '^[a-z][a-z0-9][a-zA-Z0-9]
$'.
[WARNING] src/main/java/org/apache/arrow/tools/FileRoundtrip.java:[110,26] (naming) CatchParameterName: Catch parameter name 'e' must match pattern '^[a-z][a-z0-9][a-zA-Z0-9]$'.
[WARNING] src/main/java/org/apache/arrow/tools/FileRoundtrip.java:[116,52] (naming) ParameterName: Parameter name 'e' must match pattern '^[a-z][a-z0-9][a-zA-Z0-9]
$'.
[WARNING] src/main/java/org/apache/arrow/tools/EchoServer.java:[40,3] (javadoc) JavadocMethod: Missing a Javadoc comment.
[WARNING] src/main/java/org/apache/arrow/tools/EchoServer.java:[46,3] (javadoc) JavadocMethod: Missing a Javadoc comment.
[WARNING] src/main/java/org/apache/arrow/tools/EchoServer.java:[60,3] (javadoc) JavadocMethod: Missing a Javadoc comment.
[WARNING] src/main/java/org/apache/arrow/tools/EchoServer.java:[69,32] (naming) CatchParameterName: Catch parameter name 'e' must match pattern '^[a-z][a-z0-9][a-zA-Z0-9]*$'.
[WARNING] src/main/java/org/apache/arrow/tools/EchoServer.java:[76] (blocks) NeedBraces: 'if' construct must use '{}'s.
[WARNING] src/main/java/org/apache/arrow/tools/EchoServer.java:[95,5] (javadoc) JavadocMethod: Missing a Javadoc comment.
[WARNING] checkstyle:check violations detected but failOnViolation set to false
[INFO]
[INFO] --- git-commit-id-plugin:2.1.9:revision (for-jars) @ arrow-tools ---
[info] dotGitDirectory is null, aborting execution!
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ arrow-tools ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ arrow-tools ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/leif/git/arrow/java/tools/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.2:compile (default-compile) @ arrow-tools ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ arrow-tools ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/leif/git/arrow/java/tools/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.2:testCompile (default-testCompile) @ arrow-tools ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ arrow-tools ---
[INFO] Surefire report directory: /home/leif/git/arrow/java/tools/target/surefire-reports


T E S T S


T E S T S

Running org.apache.arrow.tools.TestFileRoundtrip
Running org.apache.arrow.tools.TestIntegration
16:49:47.002 [main] DEBUG i.n.u.i.l.InternalLoggerFactory - Using SLF4J as the default logging framework
16:49:47.010 [main] DEBUG io.netty.buffer.AbstractByteBuf - -Dio.netty.buffer.bytebuf.checkAccessible: true
16:49:47.017 [main] DEBUG io.netty.util.ResourceLeakDetector - -Dio.netty.leakDetection.level: simple
16:49:47.018 [main] DEBUG io.netty.util.ResourceLeakDetector - -Dio.netty.leakDetection.maxRecords: 4
16:49:47.042 [main] DEBUG i.n.util.internal.PlatformDependent0 - java.nio.Buffer.address: available
16:49:47.042 [main] DEBUG i.n.util.internal.PlatformDependent0 - sun.misc.Unsafe.theUnsafe: available
16:49:47.043 [main] DEBUG i.n.util.internal.PlatformDependent0 - sun.misc.Unsafe.copyMemory: available
16:49:47.044 [main] DEBUG i.n.util.internal.PlatformDependent0 - direct buffer constructor: available
16:49:47.046 [main] DEBUG i.n.util.internal.PlatformDependent0 - java.nio.Bits.unaligned: available, true
16:49:47.046 [main] DEBUG i.n.util.internal.PlatformDependent0 - java.nio.DirectByteBuffer.(long, int): available
16:49:47.047 [main] DEBUG io.netty.util.internal.Cleaner0 - java.nio.ByteBuffer.cleaner(): available
16:49:47.049 [main] DEBUG i.n.util.internal.PlatformDependent - Java version: 8
16:49:47.049 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.noUnsafe: false
16:49:47.049 [main] DEBUG i.n.util.internal.PlatformDependent - sun.misc.Unsafe: available
16:49:47.049 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.noJavassist: false
16:49:47.051 [main] DEBUG i.n.util.internal.PlatformDependent - Javassist: unavailable
16:49:47.051 [main] DEBUG i.n.util.internal.PlatformDependent - You don't have Javassist in your class path or you don't have enough permission to load dynamically generated classes. Please check the configuration for better performance.
16:49:47.051 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.tmpdir: /home/leif/git/arrow/java/tools/target (java.io.tmpdir)
16:49:47.051 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.bitMode: 64 (sun.arch.data.model)
16:49:47.052 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.noPreferDirect: false
16:49:47.052 [main] DEBUG i.n.util.internal.PlatformDependent - io.netty.maxDirectMemory: 1836580864 bytes
16:49:47.053 [main] DEBUG i.n.util.ResourceLeakDetectorFactory - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@4883b407
16:49:47.074 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.numHeapArenas: 8
16:49:47.074 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.numDirectArenas: 8
16:49:47.074 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.pageSize: 8192
16:49:47.074 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.maxOrder: 11
16:49:47.074 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.chunkSize: 16777216
16:49:47.075 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.tinyCacheSize: 512
16:49:47.075 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.smallCacheSize: 256
16:49:47.075 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.normalCacheSize: 64
16:49:47.075 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.maxCachedBufferCapacity: 32768
16:49:47.075 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.cacheTrimInterval: 8192
16:49:47.247 [main] DEBUG i.n.u.i.l.InternalLoggerFactory - Using SLF4J as the default logging framework
16:49:47.254 [main] DEBUG io.netty.buffer.AbstractByteBuf - -Dio.netty.buffer.bytebuf.checkAccessible: true
16:49:47.259 [main] DEBUG io.netty.util.ResourceLeakDetector - -Dio.netty.leakDetection.level: simple
16:49:47.259 [main] DEBUG io.netty.util.ResourceLeakDetector - -Dio.netty.leakDetection.maxRecords: 4
16:49:47.263 [main] DEBUG io.netty.util.Recycler - -Dio.netty.recycler.maxCapacity.default: 32768
16:49:47.264 [main] DEBUG io.netty.util.Recycler - -Dio.netty.recycler.maxSharedCapacityFactor: 2
16:49:47.264 [main] DEBUG io.netty.util.Recycler - -Dio.netty.recycler.linkCapacity: 16
16:49:47.264 [main] DEBUG io.netty.util.Recycler - -Dio.netty.recycler.ratio: 8
16:49:47.272 [main] DEBUG i.n.util.internal.PlatformDependent - org.jctools-core.MpscChunkedArrayQueue: available
16:49:47.292 [main] DEBUG i.n.util.internal.PlatformDependent0 - java.nio.Buffer.address: available
16:49:47.293 [main] DEBUG i.n.util.internal.PlatformDependent0 - sun.misc.Unsafe.theUnsafe: available
16:49:47.294 [main] DEBUG i.n.util.internal.PlatformDependent0 - sun.misc.Unsafe.copyMemory: available
16:49:47.295 [main] DEBUG i.n.util.internal.PlatformDependent0 - direct buffer constructor: available
16:49:47.297 [main] DEBUG i.n.util.internal.PlatformDependent0 - java.nio.Bits.unaligned: available, true
16:49:47.297 [main] DEBUG i.n.util.internal.PlatformDependent0 - java.nio.DirectByteBuffer.(long, int): available
16:49:47.298 [main] DEBUG io.netty.util.internal.Cleaner0 - java.nio.ByteBuffer.cleaner(): available
16:49:47.300 [main] DEBUG i.n.util.internal.PlatformDependent - Java version: 8
16:49:47.300 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.noUnsafe: false
16:49:47.300 [main] DEBUG i.n.util.internal.PlatformDependent - sun.misc.Unsafe: available
16:49:47.300 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.noJavassist: false
16:49:47.302 [main] DEBUG i.n.util.internal.PlatformDependent - Javassist: unavailable
16:49:47.302 [main] DEBUG i.n.util.internal.PlatformDependent - You don't have Javassist in your class path or you don't have enough permission to load dynamically generated classes. Please check the configuration for better performance.
16:49:47.302 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.tmpdir: /home/leif/git/arrow/java/tools/target (java.io.tmpdir)
16:49:47.303 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.bitMode: 64 (sun.arch.data.model)
16:49:47.303 [main] DEBUG i.n.util.internal.PlatformDependent - -Dio.netty.noPreferDirect: false
16:49:47.304 [main] DEBUG i.n.util.internal.PlatformDependent - io.netty.maxDirectMemory: 1836580864 bytes
16:49:47.311 [main] DEBUG i.n.util.ResourceLeakDetectorFactory - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@76a4d6c
16:49:47.329 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.numHeapArenas: 8
16:49:47.331 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.numDirectArenas: 8
16:49:47.331 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.pageSize: 8192
16:49:47.332 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.maxOrder: 11
16:49:47.332 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.chunkSize: 16777216
16:49:47.332 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.tinyCacheSize: 512
16:49:47.332 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.smallCacheSize: 256
16:49:47.333 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.normalCacheSize: 64
16:49:47.334 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.maxCachedBufferCapacity: 32768
16:49:47.334 [main] DEBUG i.n.buffer.PooledByteBufAllocator - -Dio.netty.allocator.cacheTrimInterval: 8192
16:49:47.531 [main] DEBUG io.netty.util.Recycler - -Dio.netty.recycler.maxCapacity.default: 32768
16:49:47.531 [main] DEBUG io.netty.util.Recycler - -Dio.netty.recycler.maxSharedCapacityFactor: 2
16:49:47.531 [main] DEBUG io.netty.util.Recycler - -Dio.netty.recycler.linkCapacity: 16
16:49:47.531 [main] DEBUG io.netty.util.Recycler - -Dio.netty.recycler.ratio: 8
16:49:47.537 [main] DEBUG i.n.util.internal.PlatformDependent - org.jctools-core.MpscChunkedArrayQueue: available
16:49:47.720 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:47.722 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:47.726 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:47.727 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 168
16:49:47.727 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:47.727 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 252
16:49:47.729 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1
16:49:47.729 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:47.729 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:47.730 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40
16:49:47.730 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2
16:49:47.730 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80
16:49:47.731 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:47.731 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152
16:49:47.731 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:47.731 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1
16:49:47.731 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7
16:49:47.731 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:47.732 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 178, metadata: 158, body: 24
16:49:47.732 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:47.733 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216
16:49:47.733 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:47.733 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:47.733 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:47.733 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40
16:49:47.733 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:47.733 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:47.733 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80
16:49:47.734 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 262, metadata: 226, body: 136
16:49:47.734 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216
16:49:47.734 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:47.735 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 360, length: 216
16:49:47.735 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:47.735 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 586
16:49:47.737 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 296
16:49:47.737 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:47.737 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 624, length: 296
16:49:47.738 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:47.738 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 930
16:49:47.752 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors].
16:49:47.752 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors].
16:49:47.756 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:47.757 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:47.757 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 168
16:49:47.758 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1
16:49:47.759 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:47.759 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:47.759 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152
16:49:47.759 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:47.760 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1
16:49:47.760 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7
16:49:47.760 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:47.760 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 178, metadata: 158, body: 24
16:49:47.762 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216
16:49:47.762 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:47.762 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 360, length: 216
16:49:47.762 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:47.763 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 586
16:49:47.765 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors].
16:49:47.765 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10
16:49:47.766 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 624, length: 296
16:49:47.766 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 296
16:49:47.770 [main] DEBUG org.apache.arrow.tools.FileRoundtrip - Input file size: 930
16:49:47.771 [main] DEBUG org.apache.arrow.tools.FileRoundtrip - Found schema: Schema<int: Int(32, true), bigInt: Int(64, true)>
16:49:47.771 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:47.772 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:47.772 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 252
16:49:47.773 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 262, metadata: 226, body: 136
16:49:47.774 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 362
16:49:47.779 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:47.780 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40
16:49:47.780 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2
16:49:47.782 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80
16:49:47.783 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10
16:49:47.784 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 360, length: 216
16:49:47.785 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 216
16:49:47.787 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:47.787 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40
16:49:47.788 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2
16:49:47.788 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80
16:49:47.789 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:47.789 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216
16:49:47.789 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:47.789 [main] DEBUG org.apache.arrow.tools.Integration - Input file size: 586
16:49:47.790 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:47.790 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:47.790 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40
16:49:47.790 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:47.790 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:47.790 [main] DEBUG org.apache.arrow.tools.Integration - Found schema: Schema<float: FloatingPoint(DOUBLE)>
16:49:47.790 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80
16:49:47.791 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 262, metadata: 226, body: 136
16:49:47.792 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 296
16:49:47.792 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:47.793 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 624, length: 296
16:49:47.793 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:47.793 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 930
16:49:47.793 [main] DEBUG org.apache.arrow.tools.FileRoundtrip - Output file size: 930
16:49:47.811 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10
16:49:47.811 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 624, length: 296
16:49:47.811 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 296
16:49:47.812 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 262, metadata: 226, body: 136
16:49:47.813 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 362
16:49:47.827 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:47.828 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40
16:49:47.833 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2
16:49:47.834 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80
16:49:47.848 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader].
16:49:47.850 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT].
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.765 sec - in org.apache.arrow.tools.TestFileRoundtrip
Running org.apache.arrow.tools.EchoServerTest
16:49:47.890 [main] INFO org.apache.arrow.tools.EchoServer - Starting echo server.
16:49:47.894 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 178, metadata: 158, body: 24
16:49:47.895 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 182
16:49:47.893 [main] INFO org.apache.arrow.tools.EchoServer - Running echo server on port: 34077
16:49:47.899 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1
16:49:47.899 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:47.908 [Thread-1] INFO org.apache.arrow.tools.EchoServer - Waiting to accept new client connection.
16:49:47.912 [main] DEBUG org.apache.arrow.tools.Integration - Output file size: 583
16:49:47.913 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT].
16:49:47.952 [Thread-1] INFO org.apache.arrow.tools.EchoServer - Accepted new client connection.
16:49:47.955 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:47.955 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:47.955 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 176
16:49:47.955 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 176
16:49:47.956 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:47.956 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:47.956 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:47.956 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 176
16:49:47.956 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:47.957 [Thread-1] INFO org.apache.arrow.tools.EchoServer - Echoed 0 records
16:49:47.957 [Thread-1] INFO org.apache.arrow.tools.EchoServer - Closed connection with client
16:49:47.957 [Thread-1] INFO org.apache.arrow.tools.EchoServer - Waiting to accept new client connection.
16:49:47.957 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:47.957 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 176
16:49:47.958 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:47.960 [Thread-1] INFO org.apache.arrow.tools.EchoServer - Accepted new client connection.
16:49:47.964 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:47.964 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:47.964 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 176
16:49:47.966 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:47.967 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:47.967 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:47.967 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152
16:49:47.967 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:47.967 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:47.968 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:47.968 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 180, metadata: 156, body: 24
16:49:47.968 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:47.968 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:47.968 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 176
16:49:47.969 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:47.969 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 152
16:49:47.970 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24
16:49:47.971 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:47.975 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:47.976 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:47.977 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 176
16:49:47.977 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:47.977 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:47.978 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:47.978 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152
16:49:47.978 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:47.978 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:47.978 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:47.978 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 180, metadata: 156, body: 24
16:49:47.978 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:47.978 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:47.978 [Thread-1] INFO org.apache.arrow.tools.EchoServer - Echoed 16 records
16:49:47.979 [Thread-1] INFO org.apache.arrow.tools.EchoServer - Closed connection with client
16:49:47.979 [Thread-1] INFO org.apache.arrow.tools.EchoServer - Waiting to accept new client connection.
16:49:47.979 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 176
16:49:47.979 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:47.979 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 152
16:49:47.980 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24
16:49:47.981 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:47.981 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:47.984 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:47.986 [Thread-1] INFO org.apache.arrow.tools.EchoServer - Accepted new client connection.
16:49:47.986 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:47.987 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:47.987 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 176
16:49:47.987 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 176
16:49:47.987 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:47.991 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:47.991 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:47.991 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:47.991 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 152
16:49:47.992 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152
16:49:47.992 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24
16:49:47.992 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:47.992 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:47.993 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:48.001 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.001 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.002 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.003 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 176
16:49:48.003 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.003 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.003 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.003 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152
16:49:48.003 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.003 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.003 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:48.004 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 180, metadata: 156, body: 24
16:49:48.004 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.010 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 180, metadata: 156, body: 24
16:49:48.013 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.013 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.014 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.014 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156
16:49:48.014 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152
16:49:48.014 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.014 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.014 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.014 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:48.014 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 360, metadata: 160, body: 24
16:49:48.021 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.021 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.021 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.021 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152
16:49:48.021 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.022 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.022 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.022 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:48.022 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 544, metadata: 160, body: 24
16:49:48.023 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10
16:49:48.024 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 360, length: 216
16:49:48.024 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 216
16:49:48.024 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.024 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.024 [main] DEBUG org.apache.arrow.tools.Integration - Arrow Input file size: 586
16:49:48.024 [main] DEBUG org.apache.arrow.tools.Integration - ARROW schema: Schema<float: FloatingPoint(DOUBLE)>
16:49:48.024 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.024 [main] DEBUG org.apache.arrow.tools.Integration - JSON Input file size: 583
16:49:48.025 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152
16:49:48.025 [main] DEBUG org.apache.arrow.tools.Integration - JSON schema: Schema<float: FloatingPoint(DOUBLE)>
16:49:48.025 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.025 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.025 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.025 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:48.025 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 728, metadata: 160, body: 24
16:49:48.027 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.031 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.031 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.031 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152
16:49:48.031 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.031 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.031 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.031 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:48.032 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 912, metadata: 160, body: 24
16:49:48.033 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 178, metadata: 158, body: 24
16:49:48.034 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.034 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.035 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.035 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152
16:49:48.035 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.035 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.035 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.035 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:48.035 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 1096, metadata: 160, body: 24
16:49:48.038 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.038 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.038 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.038 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152
16:49:48.038 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.038 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.039 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.039 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:48.039 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 1280, metadata: 160, body: 24
16:49:48.044 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.044 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.045 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.045 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152
16:49:48.045 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.045 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.045 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.045 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:48.045 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 1464, metadata: 160, body: 24
16:49:48.047 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.048 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.048 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.048 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152
16:49:48.048 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.048 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.048 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.048 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:48.048 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 1648, metadata: 160, body: 24
16:49:48.050 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.051 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.051 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.051 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152
16:49:48.051 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.051 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.051 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.051 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:48.051 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 1832, metadata: 160, body: 24
16:49:48.052 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.052 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.052 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 176
16:49:48.052 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.052 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 152
16:49:48.053 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24
16:49:48.054 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.054 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.056 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.058 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24
16:49:48.058 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.058 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.059 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.059 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.059 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.059 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152
16:49:48.059 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156
16:49:48.059 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.059 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.059 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.059 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:48.060 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 360, metadata: 160, body: 24
16:49:48.060 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.060 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156
16:49:48.060 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24
16:49:48.060 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.060 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.062 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.063 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.063 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.063 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152
16:49:48.063 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 182
16:49:48.063 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.067 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1
16:49:48.068 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.063 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.063 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.063 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:48.063 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 544, metadata: 160, body: 24
16:49:48.063 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.063 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156
16:49:48.064 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24
16:49:48.064 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.064 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.065 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.066 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.066 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.066 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152
16:49:48.066 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.066 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.066 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.066 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:48.066 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 728, metadata: 160, body: 24
16:49:48.066 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.066 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156
16:49:48.067 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24
16:49:48.067 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.067 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.068 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.069 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.069 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.069 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152
16:49:48.069 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.069 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.069 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.069 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:48.069 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 912, metadata: 160, body: 24
16:49:48.069 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.069 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156
16:49:48.070 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24
16:49:48.070 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.070 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.071 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.072 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.072 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.072 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152
16:49:48.072 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.072 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.072 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.072 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:48.072 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 1096, metadata: 160, body: 24
16:49:48.072 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.072 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156
16:49:48.073 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24
16:49:48.073 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.073 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.075 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.075 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.075 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.075 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152
16:49:48.075 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.075 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.075 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.075 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:48.075 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 1280, metadata: 160, body: 24
16:49:48.075 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.075 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156
16:49:48.076 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24
16:49:48.076 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.076 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.077 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.078 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.078 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.078 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152
16:49:48.078 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.078 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.078 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.078 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:48.078 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 1464, metadata: 160, body: 24
16:49:48.078 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.079 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156
16:49:48.079 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24
16:49:48.079 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.079 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.082 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT].
16:49:48.082 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.082 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.083 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.083 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152
16:49:48.083 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.083 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.083 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.083 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:48.083 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 1648, metadata: 160, body: 24
16:49:48.083 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.083 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156
16:49:48.084 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24
16:49:48.084 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT].
16:49:48.084 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.084 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.085 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.085 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.086 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.086 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152
16:49:48.086 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.086 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.086 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.086 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:48.086 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 1832, metadata: 160, body: 24
16:49:48.086 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.086 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.086 [Thread-1] INFO org.apache.arrow.tools.EchoServer - Echoed 160 records
16:49:48.087 [Thread-1] INFO org.apache.arrow.tools.EchoServer - Closed connection with client
16:49:48.087 [Thread-1] INFO org.apache.arrow.tools.EchoServer - Waiting to accept new client connection.
16:49:48.087 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24
16:49:48.088 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.088 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.090 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.090 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156
16:49:48.090 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24
16:49:48.091 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.092 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.094 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.094 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156
16:49:48.094 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24
16:49:48.095 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.095 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.097 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.097 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156
16:49:48.098 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24
16:49:48.099 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.099 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.101 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.101 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156
16:49:48.102 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24
16:49:48.107 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.107 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.110 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.111 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156
16:49:48.112 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24
16:49:48.116 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.117 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.118 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.119 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156
16:49:48.120 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24
16:49:48.121 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.121 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.124 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.124 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156
16:49:48.125 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24
16:49:48.132 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.132 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.134 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.135 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 156
16:49:48.135 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 24
16:49:48.136 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.136 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.141 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.152 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.157 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.157 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 252
16:49:48.157 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.158 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40
16:49:48.158 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2
16:49:48.159 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80
16:49:48.159 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.159 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216
16:49:48.159 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.159 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.160 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.160 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40
16:49:48.160 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.160 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.160 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80
16:49:48.160 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 262, metadata: 226, body: 136
16:49:48.162 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 296
16:49:48.162 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.162 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 624, length: 296
16:49:48.162 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.167 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 930
16:49:48.170 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors].
16:49:48.175 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10
16:49:48.175 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 624, length: 296
16:49:48.175 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 296
16:49:48.176 [main] DEBUG org.apache.arrow.tools.Integration - Input file size: 930
16:49:48.176 [main] DEBUG org.apache.arrow.tools.Integration - Found schema: Schema<int: Int(32, true), bigInt: Int(64, true)>
16:49:48.177 [Thread-1] INFO org.apache.arrow.tools.EchoServer - Accepted new client connection.
16:49:48.178 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.179 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1
16:49:48.179 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.179 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 9
16:49:48.181 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.181 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 232
16:49:48.181 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 232
16:49:48.182 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.182 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.182 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 208
16:49:48.182 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 208
16:49:48.183 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 33
16:49:48.183 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1
16:49:48.183 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7
16:49:48.183 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:48.184 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 9
16:49:48.184 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1
16:49:48.184 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.185 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 9
16:49:48.186 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.186 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - DictionaryRecordBatch at 236, metadata: 212, body: 41
16:49:48.187 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1
16:49:48.187 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 24
16:49:48.187 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.187 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 155
16:49:48.187 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152
16:49:48.187 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 3
16:49:48.188 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 32
16:49:48.188 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1
16:49:48.188 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7
16:49:48.188 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 24
16:49:48.189 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1
16:49:48.189 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 24
16:49:48.189 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 481, metadata: 159, body: 32
16:49:48.190 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.190 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.190 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1
16:49:48.190 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 12
16:49:48.190 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 9
16:49:48.190 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.191 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 232
16:49:48.191 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 232
16:49:48.191 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.191 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 208
16:49:48.191 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1
16:49:48.191 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7
16:49:48.191 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.191 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 12
16:49:48.191 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 208
16:49:48.191 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.191 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 9
16:49:48.192 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - DictionaryRecordBatch at 236, metadata: 212, body: 41
16:49:48.196 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 33
16:49:48.196 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 262, metadata: 226, body: 136
16:49:48.197 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1
16:49:48.197 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 12
16:49:48.197 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 9
16:49:48.198 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 362
16:49:48.198 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1
16:49:48.198 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 24
16:49:48.199 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.199 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 152
16:49:48.199 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 3
16:49:48.199 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1
16:49:48.199 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7
16:49:48.199 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 24
16:49:48.199 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 481, metadata: 159, body: 32
16:49:48.199 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.199 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.199 [Thread-1] INFO org.apache.arrow.tools.EchoServer - Echoed 6 records
16:49:48.201 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.202 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40
16:49:48.203 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2
16:49:48.203 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80
16:49:48.203 [Thread-1] INFO org.apache.arrow.tools.EchoServer - Closed connection with client
16:49:48.203 [Thread-1] INFO org.apache.arrow.tools.EchoServer - Waiting to accept new client connection.
16:49:48.207 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.208 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 155
16:49:48.210 [main] DEBUG org.apache.arrow.tools.Integration - Output file size: 1110
16:49:48.216 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 32
16:49:48.217 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1
16:49:48.218 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 24
16:49:48.222 [main] DEBUG io.netty.buffer.ArrowBuf - event log for: ArrowBuf[193]
53022085832715 create()
at org.apache.arrow.memory.util.StackTrace.(StackTrace.java:35)
at org.apache.arrow.memory.util.HistoricalLog$Event.(HistoricalLog.java:185)
at org.apache.arrow.memory.util.HistoricalLog.recordEvent(HistoricalLog.java:85)
at io.netty.buffer.ArrowBuf.(ArrowBuf.java:85)
at org.apache.arrow.memory.AllocationManager$BufferLedger.newArrowBuf(AllocationManager.java:400)
at io.netty.buffer.ArrowBuf.retain(ArrowBuf.java:199)
at org.apache.arrow.vector.BaseDataValueVector.load(BaseDataValueVector.java:130)
at org.apache.arrow.vector.BaseDataValueVector.load(BaseDataValueVector.java:41)
at org.apache.arrow.vector.NullableVarCharVector.loadFieldBuffers(NullableVarCharVector.java:152)
at org.apache.arrow.vector.VectorLoader.loadBuffers(VectorLoader.java:79)
at org.apache.arrow.vector.VectorLoader.load(VectorLoader.java:61)
at org.apache.arrow.vector.file.ArrowReader.load(ArrowReader.java:203)
at org.apache.arrow.vector.file.ArrowReader.access$000(ArrowReader.java:45)
at org.apache.arrow.vector.file.ArrowReader$1.visit(ArrowReader.java:98)
at org.apache.arrow.vector.file.ArrowReader$1.visit(ArrowReader.java:95)
at org.apache.arrow.vector.schema.ArrowDictionaryBatch.accepts(ArrowDictionaryBatch.java:49)
at org.apache.arrow.vector.file.ArrowReader.loadNextBatch(ArrowReader.java:109)
at org.apache.arrow.tools.EchoServerTest.testFlatDictionary(EchoServerTest.java:202)
at sun.reflect.NativeMethodAccessorImpl.invoke0(NativeMethodAccessorImpl.java:-2)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at mockit.integration.junit4.internal.JUnit4TestRunnerDecorator.executeTestMethod(JUnit4TestRunnerDecorator.java:120)
at mockit.integration.junit4.internal.JUnit4TestRunnerDecorator.invokeExplosively(JUnit4TestRunnerDecorator.java:65)
at mockit.integration.junit4.internal.MockFrameworkMethod.invokeExplosively(MockFrameworkMethod.java:29)
at sun.reflect.NativeMethodAccessorImpl.invoke0(NativeMethodAccessorImpl.java:-2)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at mockit.internal.util.MethodReflection.invokeWithCheckedThrows(MethodReflection.java:95)
at mockit.internal.annotations.MockMethodBridge.callMock(MockMethodBridge.java:76)
at mockit.internal.annotations.MockMethodBridge.invoke(MockMethodBridge.java:41)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:-1)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)

16:49:48.224 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT].
16:49:48.225 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT].
16:49:48.251 [Thread-1] INFO org.apache.arrow.tools.EchoServer - Accepted new client connection.
16:49:48.252 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.252 [main] DEBUG org.apache.arrow.tools.Integration - Input file size: 1110
16:49:48.252 [main] DEBUG org.apache.arrow.tools.Integration - Found schema: Schema<int: Int(32, true), bigInt: Int(64, true)>
16:49:48.252 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1
16:49:48.252 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 12
16:49:48.253 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.253 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 6
16:49:48.253 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.253 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.253 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 328
16:49:48.253 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 328
16:49:48.253 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 252
16:49:48.254 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.255 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.255 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 208
16:49:48.255 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 208
16:49:48.256 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1
16:49:48.256 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7
16:49:48.256 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 12
16:49:48.256 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.256 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.256 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 30
16:49:48.256 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - DictionaryRecordBatch at 332, metadata: 212, body: 38
16:49:48.256 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1
16:49:48.257 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 12
16:49:48.257 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 6
16:49:48.257 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1
16:49:48.257 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.257 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 1
16:49:48.259 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.259 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40
16:49:48.260 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2
16:49:48.260 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80
16:49:48.258 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.258 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 32, length: 16
16:49:48.258 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.258 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 222
16:49:48.258 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216
16:49:48.258 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.261 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.259 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 48
16:49:48.260 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1
16:49:48.260 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7
16:49:48.260 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:48.260 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1
16:49:48.260 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7
16:49:48.260 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:48.261 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216
16:49:48.261 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.261 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.261 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.261 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1
16:49:48.261 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.261 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40
16:49:48.261 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 1
16:49:48.262 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.262 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.262 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 32, length: 16
16:49:48.262 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80
16:49:48.262 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 262, metadata: 226, body: 136
16:49:48.263 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1
16:49:48.263 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 296
16:49:48.263 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 8
16:49:48.263 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 16, length: 6
16:49:48.263 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.264 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 624, length: 296
16:49:48.264 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.264 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.264 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 328
16:49:48.264 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 930
16:49:48.264 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.264 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 208
16:49:48.264 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1
16:49:48.264 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7
16:49:48.264 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 8
16:49:48.264 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.264 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - DictionaryRecordBatch at 332, metadata: 212, body: 30
16:49:48.265 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1
16:49:48.265 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.265 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 1
16:49:48.265 [Thread-1] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 32, length: 16
16:49:48.265 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.265 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216
16:49:48.265 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.265 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1
16:49:48.265 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7
16:49:48.265 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:48.265 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1
16:49:48.265 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7
16:49:48.265 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 16
16:49:48.266 [Thread-1] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 566, metadata: 226, body: 48
16:49:48.266 [Thread-1] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.266 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 574, metadata: 226, body: 48
16:49:48.266 [main] DEBUG org.apache.arrow.tools.Integration - Output file size: 930
16:49:48.266 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.266 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.267 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 328
16:49:48.267 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT].
16:49:48.267 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.267 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 208
16:49:48.267 [Thread-1] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.267 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10
16:49:48.268 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 624, length: 296
16:49:48.268 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 296
Exception in thread "Thread-1" java.lang.IllegalStateException
at com.google.common.base.Preconditions.checkState(Preconditions.java:158)
at org.apache.arrow.tools.EchoServer$ClientConnection.run(EchoServer.java:117)
at org.apache.arrow.tools.EchoServer.run(EchoServer.java:68)
at org.apache.arrow.tools.EchoServerTest$1.run(EchoServerTest.java:78)
16:49:48.268 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 262, metadata: 226, body: 136
16:49:48.268 [Thread-1] INFO org.apache.arrow.tools.EchoServer - Server closed.
16:49:48.269 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 362
16:49:48.270 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 22
16:49:48.271 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1
16:49:48.271 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 8
16:49:48.271 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 16, length: 6
16:49:48.272 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.273 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 4
16:49:48.273 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 222
16:49:48.273 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40
16:49:48.273 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2
16:49:48.274 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 48
16:49:48.274 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80
16:49:48.275 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1
16:49:48.275 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 16
16:49:48.275 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 24, length: 1
16:49:48.275 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 32, length: 16
16:49:48.279 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[reader].
16:49:48.281 [main] DEBUG io.netty.buffer.ArrowBuf - event log for: ArrowBuf[230]
53022159371714 create()
at org.apache.arrow.memory.util.StackTrace.(StackTrace.java:35)
at org.apache.arrow.memory.util.HistoricalLog$Event.(HistoricalLog.java:185)
at org.apache.arrow.memory.util.HistoricalLog.recordEvent(HistoricalLog.java:85)
at io.netty.buffer.ArrowBuf.(ArrowBuf.java:85)
at org.apache.arrow.memory.AllocationManager$BufferLedger.newArrowBuf(AllocationManager.java:400)
at io.netty.buffer.ArrowBuf.retain(ArrowBuf.java:199)
at org.apache.arrow.vector.BaseDataValueVector.load(BaseDataValueVector.java:130)
at org.apache.arrow.vector.BaseDataValueVector.load(BaseDataValueVector.java:41)
at org.apache.arrow.vector.NullableVarCharVector.loadFieldBuffers(NullableVarCharVector.java:152)
at org.apache.arrow.vector.VectorLoader.loadBuffers(VectorLoader.java:79)
at org.apache.arrow.vector.VectorLoader.load(VectorLoader.java:61)
at org.apache.arrow.vector.file.ArrowReader.load(ArrowReader.java:203)
at org.apache.arrow.vector.file.ArrowReader.access$000(ArrowReader.java:45)
at org.apache.arrow.vector.file.ArrowReader$1.visit(ArrowReader.java:98)
at org.apache.arrow.vector.file.ArrowReader$1.visit(ArrowReader.java:95)
at org.apache.arrow.vector.schema.ArrowDictionaryBatch.accepts(ArrowDictionaryBatch.java:49)
at org.apache.arrow.vector.file.ArrowReader.loadNextBatch(ArrowReader.java:109)
at org.apache.arrow.tools.EchoServerTest.testNestedDictionary(EchoServerTest.java:280)
at sun.reflect.NativeMethodAccessorImpl.invoke0(NativeMethodAccessorImpl.java:-2)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at mockit.integration.junit4.internal.JUnit4TestRunnerDecorator.executeTestMethod(JUnit4TestRunnerDecorator.java:120)
at mockit.integration.junit4.internal.JUnit4TestRunnerDecorator.invokeExplosively(JUnit4TestRunnerDecorator.java:65)
at mockit.integration.junit4.internal.MockFrameworkMethod.invokeExplosively(MockFrameworkMethod.java:29)
at sun.reflect.NativeMethodAccessorImpl.invoke0(NativeMethodAccessorImpl.java:-2)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at mockit.internal.util.MethodReflection.invokeWithCheckedThrows(MethodReflection.java:95)
at mockit.internal.annotations.MockMethodBridge.callMock(MockMethodBridge.java:76)
at mockit.internal.annotations.MockMethodBridge.invoke(MockMethodBridge.java:41)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:-1)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)

16:49:48.283 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT].
16:49:48.289 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10
16:49:48.289 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 624, length: 296
16:49:48.289 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 296
16:49:48.290 [main] DEBUG org.apache.arrow.tools.Integration - Arrow Input file size: 930
16:49:48.290 [main] DEBUG org.apache.arrow.tools.Integration - ARROW schema: Schema<int: Int(32, true), bigInt: Int(64, true)>
16:49:48.290 [main] DEBUG org.apache.arrow.tools.Integration - JSON Input file size: 1110
16:49:48.290 [main] DEBUG org.apache.arrow.tools.Integration - JSON schema: Schema<int: Int(32, true), bigInt: Int(64, true)>
16:49:48.293 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 262, metadata: 226, body: 136
16:49:48.293 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 362
16:49:48.299 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.299 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40
16:49:48.300 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2
16:49:48.300 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80
16:49:48.305 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT].
16:49:48.306 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT].
16:49:48.312 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.313 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.313 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 252
16:49:48.313 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.314 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40
16:49:48.314 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2
16:49:48.314 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80
16:49:48.314 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.314 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216
16:49:48.314 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.315 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.315 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.315 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40
16:49:48.315 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.315 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.315 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80
16:49:48.315 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 262, metadata: 226, body: 136
16:49:48.316 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 296
16:49:48.316 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.316 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 624, length: 296
16:49:48.316 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.316 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 930
16:49:48.318 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors].
16:49:48.322 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.322 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.323 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 252
16:49:48.323 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.323 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40
16:49:48.323 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2
16:49:48.324 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80
16:49:48.324 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.324 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 216
16:49:48.324 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.324 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.324 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.324 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40
16:49:48.324 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.324 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.324 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 80
16:49:48.324 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 262, metadata: 226, body: 136
16:49:48.325 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 296
16:49:48.325 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.325 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 624, length: 296
16:49:48.325 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.326 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 930
16:49:48.327 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[original vectors].
16:49:48.327 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10
16:49:48.328 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 624, length: 296
16:49:48.328 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 296
16:49:48.328 [main] DEBUG org.apache.arrow.tools.Integration - Input file size: 930
16:49:48.328 [main] DEBUG org.apache.arrow.tools.Integration - Found schema: Schema<int: Int(32, true), bigInt: Int(64, true)>
16:49:48.334 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 262, metadata: 226, body: 136
16:49:48.338 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 362
16:49:48.341 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.341 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40
16:49:48.341 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2
16:49:48.341 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80
16:49:48.346 [main] DEBUG org.apache.arrow.tools.Integration - Output file size: 1110
16:49:48.347 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT].
Tests run: 3, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 0.418 sec <<< FAILURE! - in org.apache.arrow.tools.EchoServerTest
testFlatDictionary(org.apache.arrow.tools.EchoServerTest) Time elapsed: 0.088 sec <<< ERROR!
java.lang.IndexOutOfBoundsException: index: 12, length: 4 (expected: range(0, 12))
at io.netty.buffer.ArrowBuf.checkIndexD(ArrowBuf.java:138)
at io.netty.buffer.ArrowBuf.chk(ArrowBuf.java:161)
at io.netty.buffer.ArrowBuf.getInt(ArrowBuf.java:526)
at org.apache.arrow.vector.UInt4Vector$Accessor.get(UInt4Vector.java:341)
at org.apache.arrow.vector.VarCharVector$Accessor.get(VarCharVector.java:419)
at org.apache.arrow.vector.VarCharVector$Accessor.getObject(VarCharVector.java:449)
at org.apache.arrow.vector.NullableVarCharVector$Accessor.getObject(NullableVarCharVector.java:434)
at org.apache.arrow.tools.EchoServerTest.testFlatDictionary(EchoServerTest.java:229)

testNestedDictionary(org.apache.arrow.tools.EchoServerTest) Time elapsed: 0.048 sec <<< ERROR!
java.lang.IndexOutOfBoundsException: index: 8, length: 4 (expected: range(0, 8))
at io.netty.buffer.ArrowBuf.checkIndexD(ArrowBuf.java:138)
at io.netty.buffer.ArrowBuf.chk(ArrowBuf.java:161)
at io.netty.buffer.ArrowBuf.getInt(ArrowBuf.java:526)
at org.apache.arrow.vector.UInt4Vector$Accessor.get(UInt4Vector.java:341)
at org.apache.arrow.vector.VarCharVector$Accessor.get(VarCharVector.java:419)
at org.apache.arrow.vector.VarCharVector$Accessor.getObject(VarCharVector.java:449)
at org.apache.arrow.vector.NullableVarCharVector$Accessor.getObject(NullableVarCharVector.java:434)
at org.apache.arrow.tools.EchoServerTest.testNestedDictionary(EchoServerTest.java:312)

16:49:48.297 [threadDeathWatcher-1-1] DEBUG io.netty.buffer.PoolThreadCache - Freed 3 thread-local buffer(s) from thread: Thread-1
16:49:48.358 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10
16:49:48.358 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 624, length: 296
16:49:48.358 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 296
16:49:48.359 [main] DEBUG org.apache.arrow.tools.Integration - Arrow Input file size: 930
16:49:48.359 [main] DEBUG org.apache.arrow.tools.Integration - ARROW schema: Schema<int: Int(32, true), bigInt: Int(64, true)>
16:49:48.359 [main] DEBUG org.apache.arrow.tools.Integration - JSON Input file size: 1110
16:49:48.359 [main] DEBUG org.apache.arrow.tools.Integration - JSON schema: Schema<int: Int(32, true), bigInt: Int(64, true)>
16:49:48.362 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 262, metadata: 226, body: 136
16:49:48.363 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 362
16:49:48.364 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.364 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 40
16:49:48.364 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 2
16:49:48.364 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 80
16:49:48.367 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT].
16:49:48.377 [main] DEBUG org.apache.arrow.tools.Integration - Input file size: 4846
16:49:48.378 [main] DEBUG org.apache.arrow.tools.Integration - Found schema: Schema<struct_nullable: Struct<f1: Int(32, true), f2: Utf8>>
16:49:48.400 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.400 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.400 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 336
16:49:48.406 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1
16:49:48.406 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 1
16:49:48.406 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 16, length: 28
16:49:48.406 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 1
16:49:48.406 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 32
16:49:48.407 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 88, length: 28
16:49:48.407 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.407 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 280
16:49:48.407 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.407 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1
16:49:48.407 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7
16:49:48.407 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1
16:49:48.407 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7
16:49:48.407 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 28
16:49:48.407 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.407 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1
16:49:48.407 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7
16:49:48.408 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 32
16:49:48.408 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 28
16:49:48.408 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 346, metadata: 286, body: 116
16:49:48.415 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.416 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 2
16:49:48.416 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 16, length: 40
16:49:48.416 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 2
16:49:48.416 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 64, length: 44
16:49:48.416 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 112, length: 49
16:49:48.417 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.417 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 280
16:49:48.417 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.417 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.417 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.417 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.417 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40
16:49:48.417 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 2
16:49:48.417 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.417 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 44
16:49:48.417 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.417 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 49
16:49:48.418 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 748, metadata: 284, body: 161
16:49:48.421 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 408
16:49:48.422 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.422 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 1193, length: 408
16:49:48.422 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.422 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 1611
16:49:48.423 [main] DEBUG org.apache.arrow.tools.Integration - Output file size: 1611
16:49:48.424 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT].
16:49:48.425 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10
16:49:48.425 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 1193, length: 408
16:49:48.425 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 408
16:49:48.426 [main] DEBUG org.apache.arrow.tools.Integration - Input file size: 1611
16:49:48.426 [main] DEBUG org.apache.arrow.tools.Integration - Found schema: Schema<struct_nullable: Struct<f1: Int(32, true), f2: Utf8>>
16:49:48.444 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 346, metadata: 286, body: 116
16:49:48.445 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 402
16:49:48.448 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1
16:49:48.448 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 1
16:49:48.449 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 16, length: 28
16:49:48.449 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 48, length: 1
16:49:48.450 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 32
16:49:48.450 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 88, length: 28
16:49:48.462 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 748, metadata: 284, body: 161
16:49:48.463 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 445
16:49:48.465 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 2
16:49:48.466 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 2
16:49:48.466 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 16, length: 40
16:49:48.466 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 56, length: 2
16:49:48.467 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 64, length: 44
16:49:48.467 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 112, length: 49
16:49:48.475 [main] DEBUG org.apache.arrow.tools.Integration - Output file size: 2337
16:49:48.476 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT].
16:49:48.500 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT].
16:49:48.517 [main] DEBUG org.apache.arrow.tools.Integration - Input file size: 1583
16:49:48.518 [main] DEBUG org.apache.arrow.tools.Integration - Found schema: Schema<foo: Int(32, true), bar: FloatingPoint(DOUBLE), baz: Utf8>
16:49:48.518 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.518 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.518 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 348
16:49:48.523 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1
16:49:48.523 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 20
16:49:48.524 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 32, length: 1
16:49:48.524 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 40, length: 40
16:49:48.524 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 80, length: 1
16:49:48.524 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 88, length: 24
16:49:48.524 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 112, length: 9
16:49:48.525 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.525 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 304
16:49:48.525 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.525 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1
16:49:48.525 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7
16:49:48.525 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 20
16:49:48.525 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.525 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1
16:49:48.525 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7
16:49:48.525 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 40
16:49:48.526 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 1
16:49:48.526 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 7
16:49:48.526 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 24
16:49:48.526 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 9
16:49:48.526 [main] DEBUG o.a.arrow.vector.file.ArrowWriter - RecordBatch at 358, metadata: 314, body: 121
16:49:48.527 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 392
16:49:48.527 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 4
16:49:48.527 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - Footer starts at 793, length: 392
16:49:48.527 [main] DEBUG o.a.arrow.vector.file.WriteChannel - Writing buffer with size: 6
16:49:48.528 [main] DEBUG o.a.a.vector.file.ArrowFileWriter - magic written, now at 1195
16:49:48.529 [main] DEBUG org.apache.arrow.tools.Integration - Output file size: 1195
16:49:48.529 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT].
16:49:48.530 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 10
16:49:48.530 [main] DEBUG o.a.a.vector.file.ArrowFileReader - Footer starts at 793, length: 392
16:49:48.530 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 392
16:49:48.531 [main] DEBUG org.apache.arrow.tools.Integration - Input file size: 1195
16:49:48.531 [main] DEBUG org.apache.arrow.tools.Integration - Found schema: Schema<foo: Int(32, true), bar: FloatingPoint(DOUBLE), baz: Utf8>
16:49:48.542 [main] DEBUG o.a.a.vector.file.ArrowFileReader - RecordBatch at 358, metadata: 314, body: 121
16:49:48.542 [main] DEBUG o.a.arrow.vector.file.ReadChannel - Reading buffer with size: 435
16:49:48.556 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 0, length: 1
16:49:48.556 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 8, length: 20
16:49:48.556 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 32, length: 1
16:49:48.556 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 40, length: 40
16:49:48.557 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 80, length: 1
16:49:48.557 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 88, length: 24
16:49:48.557 [main] DEBUG o.a.a.vector.schema.ArrowRecordBatch - Buffer in RecordBatch at 112, length: 9
16:49:48.563 [main] DEBUG org.apache.arrow.tools.Integration - Output file size: 1599
16:49:48.564 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT].
16:49:48.572 [main] DEBUG o.apache.arrow.memory.BaseAllocator - closed allocator[ROOT].
Tests run: 5, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 2.441 sec <<< FAILURE! - in org.apache.arrow.tools.TestIntegration
testJSONRoundTripWithStruct(org.apache.arrow.tools.TestIntegration) Time elapsed: 0.137 sec <<< FAILURE!
org.junit.ComparisonFailure: line: 10 expected:<...Vd88fp","","3loZrRf"[,""]],> but was:<...Vd88fp","","3loZrRf"[]],>
at org.apache.arrow.tools.TestIntegration.testJSONRoundTripWithStruct(TestIntegration.java:210)

testJSONRoundTripWithVariableWidth(org.apache.arrow.tools.TestIntegration) Time elapsed: 0.066 sec <<< FAILURE!
org.junit.ComparisonFailure: line: 13 expected:<... : ["aa","","","bbb"[,"cccc"]],> but was:<... : ["aa","","","bbb"[]],>
at org.apache.arrow.tools.TestIntegration.testJSONRoundTripWithVariableWidth(TestIntegration.java:180)

Results :

Failed tests:
TestIntegration.testJSONRoundTripWithStruct:210 line: 10 expected:<...Vd88fp","","3loZrRf"[,""]],> but was:<...Vd88fp","","3loZrRf"[]],>
TestIntegration.testJSONRoundTripWithVariableWidth:180 line: 13 expected:<... : ["aa","","","bbb"[,"cccc"]],> but was:<... : ["aa","","","bbb"[]],>

Tests in error:
EchoServerTest.testFlatDictionary:229 » IndexOutOfBounds index: 12, length: 4 ...
EchoServerTest.testNestedDictionary:312 » IndexOutOfBounds index: 8, length: 4...

Tests run: 9, Failures: 2, Errors: 2, Skipped: 0

</details>

@leifwalsh
Copy link
Copy Markdown
Contributor

Ok, what is in that array on the C++ side?

@leifwalsh
Copy link
Copy Markdown
Contributor

I'm guessing we need to relax that check, but if there's no valid data in there, what are we doing truncating it to be larger? Is there garbage there or does there need to be something?

@wesm
Copy link
Copy Markdown
Member Author

wesm commented Apr 7, 2017

The array in C++ is going to have an offsets array of length 1 with a single 0 as a value https://github.com/apache/arrow/blob/master/cpp/src/arrow/ipc/json-internal.cc#L978

@leifwalsh
Copy link
Copy Markdown
Contributor

Ok, what's the semantic meaning of that 0? I will go start reading the spec but if you can give me a leg up that would be helpful.

@leifwalsh
Copy link
Copy Markdown
Contributor

As in, what should the Java code be doing with that value?

@leifwalsh
Copy link
Copy Markdown
Contributor

From the docs:

An array with nulls must have a contiguous memory buffer, known as the null (or validity) bitmap, whose length is a multiple of 64 bytes (as discussed above) and large enough to have at least 1 bit for each array slot.

In this case it looks like the length is only 4 bytes, which I think violates that?

@leifwalsh
Copy link
Copy Markdown
Contributor

Sorry you were talking about the offsets vector, not the nullability vector. My mistake.

@leifwalsh
Copy link
Copy Markdown
Contributor

Ok, according to the List layout, the single element in the offsets array is either 0 or unspecified, and the spec doesn't make it clear which it is (but I believe 0 makes sense). Is this just meant to be ignored?

@wesm
Copy link
Copy Markdown
Member Author

wesm commented Apr 7, 2017

It seems maybe the issue is that Java is ignoring the 0 for length 0. Having a single 0 (or any value) is correct, though, per the spec

@leifwalsh
Copy link
Copy Markdown
Contributor

Ok, I have dug around and cannot figure out what would need to change to get the Java code to accept this truncation. I hope @julienledem or @jacques-n can take a look soon and make good use of the debugging I've done so far and spot what needs to change easily. If either of you want more info from me let me know, I am putting this on the back burner for now though, I don't plan to look at it any more until I hear more. If you can point me to what needs to change though, I can do the change and do the work of testing it.

@wesm
Copy link
Copy Markdown
Member Author

wesm commented Apr 8, 2017

I think I figured out the problem, there's bugs both in C++ and Java. Will update patch with fix if I can get the respective test suites and integration tests passing

@wesm wesm changed the title ARROW-783: Integration test length 0 batches ARROW-783: [Java/C++] Fixes for 0-length record batches Apr 9, 2017
Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Here was the thing I'm not sure about. There's another place in the codebase where the offsets are nixed if the length is 0

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

hmm. I'm not sure. @StevenMPhillips or @jacques-n might know better.

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK. I don't think this does any harm, but if there's a more appropriate fix it would be good to do that (there was another place where length-0 was being special-cased already)

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We need a better way to signal EOS than a length-0 record batch (which is ambiguous)

@wesm
Copy link
Copy Markdown
Member Author

wesm commented Apr 9, 2017

@elahrvivaz would you mind also having a look at this? Thanks

@elahrvivaz
Copy link
Copy Markdown
Contributor

reader changes look good to me. I agree there should be a different way to indicate EOS - maybe changing to -1 would be minimally disruptive.

@wesm
Copy link
Copy Markdown
Member Author

wesm commented Apr 10, 2017

I think true/false is a bit more clear than -1 (and better than void in any case). I'll wait for @julienledem or @jacques-n to comment on the loader change

@elahrvivaz
Copy link
Copy Markdown
Contributor

oh, yeah I meant in the actual file format. Current we write a 4-byte zero at the end of the stream - we could change it to a -1

@wesm
Copy link
Copy Markdown
Member Author

wesm commented Apr 10, 2017

Rebased

@wesm
Copy link
Copy Markdown
Member Author

wesm commented Apr 10, 2017

@elahrvivaz the binary format itself is not an issue -- it's the Java code signaling that it's done. Before this patch, if you found a record batch with 0 rows in the middle of a stream, various code was incorrectly halting thinking the stream is finished.

@elahrvivaz
Copy link
Copy Markdown
Contributor

@wesm I'm thinking of the check for message == null - in org.apache.arrow.vector.stream.MessageSerializer#deserializeMessage we treat reading a 0 for message length as a null message, which indicates EOS. I'm not certain why or if you would ever send a zero length message, but currently you couldn't (similarly I'm not sure why you'd necessarily send a zero-length batch). Probably not a big deal though.

@wesm
Copy link
Copy Markdown
Member Author

wesm commented Apr 10, 2017

The build is passing except for the persistent S3 timeouts. I opened conda/conda#5032

@wesm
Copy link
Copy Markdown
Member Author

wesm commented Apr 10, 2017

I'm not sure why you'd necessarily send a zero-length batch

Suppose you requested a dataset with a set of predicates that result in all of the data being filtered out. The server could send a null message, but returning record batch metadata with length 0 seems okay, too. Disallowing length-0 record batches seems like it might be a source of bugs (there are multiple patches open now concerning size-0 objects)

@leifwalsh
Copy link
Copy Markdown
Contributor

I agree the system needs to provide a way to represent a zero-length, but valid, record batch. Trying to piggyback that on "null" is bound to lead to problems.

@wesm
Copy link
Copy Markdown
Member Author

wesm commented Apr 11, 2017

@julienledem could you review the Java changes here? Thanks

@wesm
Copy link
Copy Markdown
Member Author

wesm commented Apr 13, 2017

@julienledem ping on this one.

@jacques-n
Copy link
Copy Markdown
Contributor

I'd actually suggest against allowing zero length record batches entirely. I've found them to be a nuisance in my work and we make sure that they are not passed on in our work on top of arrow

@wesm
Copy link
Copy Markdown
Member Author

wesm commented Apr 13, 2017

@jacques-n that seems like an application-level concern, though. If you're writing a file or stream, and you don't want to deal with them, don't write them. At least on the Python side, we regularly deal with 0-length DataFrames, so if that's what you have and want to accurately transmit to another party, then writing a 0-length batch is probably the right thing. Otherwise, the client/receiver must be able to disambiguate between "no data" and "length-0 data".

I agree that length-0 things are annoying.

…h record batches

* Relax n + 1 restruction for 0-length vectors
@wesm
Copy link
Copy Markdown
Member Author

wesm commented Apr 13, 2017

Just rebased so maybe we'l get a passing build after ARROW-646 is in

@wesm
Copy link
Copy Markdown
Member Author

wesm commented Apr 14, 2017

Is this OK to go in?

Copy link
Copy Markdown
Member

@julienledem julienledem left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall this looks fine to me. Just made some comments that can be done later.

for (ArrowBlock rbBlock : arrowReader.getRecordBlocks()) {
arrowReader.loadRecordBatch(rbBlock);
if (!arrowReader.loadRecordBatch(rbBlock)) {
throw new IOException("Expected to load record batch");
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

add rbBlock to message

ArrowBlock rbBlock = iterator.next();
arrowReader.loadRecordBatch(rbBlock);
if (!arrowReader.loadRecordBatch(rbBlock)) {
throw new IOException("Expected to load record batch");
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same

.getFieldVectors().get(0);
for (int i = 0; i < batches; i++) {
reader.loadNextBatch();
Assert.assertTrue(reader.loadNextBatch());
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

add message with i for example

}
}
reader.loadNextBatch();
Assert.assertFalse(reader.loadNextBatch());
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

hmm. I'm not sure. @StevenMPhillips or @jacques-n might know better.


for (int n = 0; n < 2; n++) {
arrowReader.loadNextBatch();
Assert.assertTrue(arrowReader.loadNextBatch());
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

add message with i in it (see bellow)

@asfgit asfgit closed this in 01114d8 Apr 14, 2017
@wesm wesm deleted the ARROW-783 branch April 18, 2017 15:46
pribor pushed a commit to GlobalWebIndex/arrow that referenced this pull request Oct 24, 2025
@StevenMPhillips @nongli @julienledem I found a number of issues in both C++ and Java around the handling of 0-length vectors. It seems that preserving a single inconsequential offset for a length-0 variable length vector can be a bit difficult, so I relaxed a restruction in `loadFieldVectors` about this. Let me know if there's anything concerning about the other changes around EOS signaling

Author: Wes McKinney <wes.mckinney@twosigma.com>

Closes apache#505 from wesm/ARROW-783 and squashes the following commits:

28ddcab [Wes McKinney] * Have loadNextBatch return true/false for EOS to accommodate 0-length record batches * Relax n + 1 restruction for 0-length vectors
pribor pushed a commit to GlobalWebIndex/arrow that referenced this pull request Oct 24, 2025
Bumps [org.assertj:assertj-core](https://github.com/assertj/assertj)
from 3.26.3 to 3.27.2.

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants