Feature Request: Parquet File Support

[tgruben]

Any hope of getting Parquet file support anytime soon or is CSV going to remain the format of choice

[rcoreilly]

I'm guessing that Apache Arrow implements Parquet, and the etable.Tensor is Arrow compatible, so in principle this could be easy.. :)

[tgruben]

hmm, it appears etensor.Tensor doesn't fully implement arrow's tensor.Interface. Missing Retain() and Release() i think.

https://pkg.go.dev/github.com/apache/arrow/go/v10@v10.0.0-20220812184426-39a2f3beba90/arrow/tensor#Interface

[gedw99]

@tgruben that link is taking ages to load. Here is the direct code link

https://github.com/apache/arrow/tree/main/go/arrow/tensor

[gedw99]

@tgruben and @rcoreilly

Its might make sense to use DataFusions as the Data store backing all this. That means that S3 is the backing store.