@nevillelyh nevillelyh released this Sep 27, 2017 · 573 commits to master since this release

Assets 3

"Castor canadensis"

Breaking change

Beam direct runner is no longer a dependency of scio-core. Add the following dependency if you want to run a pipeline locally. The current beam version is 2.1.0.

"org.apache.beam" % "beam-runners-direct-java" % beamVersion

Features

  • Add flatten and flattenValues to SCollection #842
  • Add Annoy side input #783 #812
  • Support saving TF Example together with feature spec #816
  • Support metrics in JobTest #846 #851
  • Use Scala 2.12 for scio-repl #834 #835
  • Support custom body in BigQueryType #808
  • Add Scio Benchmark #506 #830
  • Remove direct runner dependency #777 #852
  • Remove DataflowPipelineOptions from ScioILoop #779
  • Bump Bigtable dependency #841
  • Update Algebird to 0.13.2

Bug fixes

  • Fix bug in JIterable Serializer #836
  • Fix for KryoAtomicClass serialization issue #855 #856
  • Fork in scio-examples/run #847 #848
  • Test AsyncDoFn with ScalaCheck commands #839
  • Fix GuavaAsyncDoFn flakiness #858
  • Add key to Datastore example #782
  • Patch all AvroIO files #857