Optimized Writing of Arrow Byte Array to Parquet #1764
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
A significant amount of effort has been put into making the reading of byte arrays from parquet fast:
We should invest some effort in making the writer performance comparable.
Describe the solution you'd like
Currently in order to write byte array types from arrow:
It would be a significant performance win to be able to elide these first two steps. This would likely involve much the same process as was followed for the reader:
Describe alternatives you've considered
We could not do this
The text was updated successfully, but these errors were encountered: