Skip to content

v0.2.6

Compare
Choose a tag to compare
@nevillelyh nevillelyh released this 28 Oct 15:22

"Sensu lato"

Notable changes:

  • Upgrade Dataflow Java SDK to 1.8.0
  • Save Protobuf generic schema as Avro metadata #265
  • Update BigQuery types, including better timestamp support #293
  • Improve JobTest error message for missing test wiring and materialize handling #316
  • Improve metrics API #296 #306
  • Add SideInOutExample and test #313
  • Fix @BigQueryType.toTable for case classes with optional arguments #311
  • Fix BigtableUtil.updateNumberOfBigtableNodes #309
  • Refactor HDFS #301

SCollection#saveAsProtobufFile now saves protobuf-generic schema in Avro metadata. The schema and protobuf binary records can be read with proto-tools in gcs-tools. See wiki for details.

BigQueryType now supports standard SQL types including DATE, TIME, and DATETIME. See ScalaDoc for details.