Skip to content

v0.7.1

Choose a tag to compare

@clairemcginty clairemcginty released this 08 Feb 18:45

"Taxidea Taxus"

Features

  • New HashCode-based partitioning method for keyed SCollections (#1654)
  • New Coder for java.lang.ArrayList (#1649), and more space-efficient coders for small ADTs like Either and Try (#1652)
  • new BinaryIO output (#1663)
  • Simpler, clearer toString method for Coders (#1671)
  • Custom Assertions for unit testing Coders added to scio-test package (#1642)
  • New SideMap and SideSet SideInput types, usable in hashFullOuterJoin, hashIntersectByKey, and hashFilter methods
  • Library version bumps: mysql-connector-java -> 8.0.15 (#1653), mysql-socket-factory -> 1.0.12 (#1627), protobuf-java -> 3.6.1 (#1633), hadoop-client -> 2.7.7 (#1634), jackson-module-scala -> 2.9.8 (#1632), parquet-avro -> 1.10.1 (#1648), kantan.csv -> 0.5.0 (#1647)

Bug fixes & Improvements

  • Optimized Bloom filter aggregations in sparse joins (#1644)
  • Spanner-specific Coders repackaged from scio-core to scio-spanner (#1630)
  • Fallback coder always uses Kryo (#1668) and RichCoderRegistry is removed (#1670)