Skip to content

v1.6.0
Compare
Choose a tag to compare
@mjakubowski84 mjakubowski84 released this 13 Oct 16:47
· 225 commits to master since this release
v1.6.0
e612f47

Release 1.6.0 brings an important feature of Parquet that was missing so far - an ability to read a subset of columns from Parquet files. This is called schema projection. And now it is available in every module of Parquet4S. Check updated Readme for more.

A new feature implied the need of redesign of API. Core library just got a new function pointing to new reader but in Akka and FS2 module a new reader builders are introduced and those deprecate the old readers.
Moreover, recently introduced FS2 module received several API fixes that may be breaking for some. Unfortunately, those were required for consistency.

Full list of changes:

  • core:
    • ParquetReader.withProjection[YourSchema] that points to the reader that has schema projection applied
  • akka:
    • ParquetStreams.fromParquet[YourSchema](path, options, filter) is deprecated in favour of builder with the same name: ParquetStreams.fromParquet[YourSchema]
  • fs2:
    • function parquet.read is deprecated in favour of builder parquet.fromParquet
    • trait of Builder used in API of parquet.viaParquet is moved to rotatingWriter package
    • withPreWriteTransformation in parquet.viaParquet is replaced by preWriteTransformation for consistency
    • redundant dependency of parquet.viaParquet to implicit Sync[F] is removed as it has already dependency to Concurrent[F]
    • parquet.writeSingleFile returns now Stream[F, fs2.INothing] instead of Stream[F, Unit] in order to emphasise that it doesn't emit anything
Assets 2