Upgrades Apache Beam to 2.76.0, expands IcebergIO write API, updates Magnolify to 0.9.8 with portable Timestamp encoding, and includes a large batch of dependency updates.
🚀 Enhancements
- Upgrade Apache Beam 2.74.0 → 2.76.0 by @shnapz in #5996
- Expand IcebergIO write API to cover all write options by @clairemcginty in #5986
- Add wrapper for setRowSchema method by @clairemcginty in #5987
- Update row group size to 256MB by @clairemcginty in #5997
- Update magnolify to 0.9.8; adopt portable Timestamp encoding for IcebergIO by @shnapz in #6000
🐛 Bug Fixes
- Fix GcsConnectorUtil auth for gcs-connector 3.x by @shnapz in #5984
- Fix fat jar merge failure from Beam 2.76 envoy proto collision by @shnapz in #6002
- Fix IcebergIOIT implicit ambiguity; compile integration tests on PR builds by @shnapz in #6001
📝 Documentation & Security
🏗️ Build Improvements
- Run Validate Steward CI on J17 by @shnapz in #5990
- Bump actions/setup-java from 5 to 6 by @dependabot[bot] in #5995
- Bump actions/checkout from 6 to 7 by @dependabot[bot] in #5947
🌱 Dependency Updates
- Update Magnolify to 0.9.6 by @clairemcginty in #5988
- Update parquet-avro, parquet-column, ... to 1.17.1 by @clairemcginty in #5971
- Update circe-core, circe-generic, ... to 0.14.16 by @clairemcginty in #5967
- Update elasticsearch-java to 8.19.18 by @clairemcginty in #5960
- Update cloud-sql-connector-jdbc-sqlserver, ... to 1.28.6 by @clairemcginty in #5963
- Update caffeine to 3.2.4 by @clairemcginty in #5961
- Update mysql-connector-j to 9.7.0 by @clairemcginty in #5964
- Update jedis to 7.5.3 by @clairemcginty in #5980
- Update snakeyaml to 2.6 by @clairemcginty in #5979
- Update jna to 5.19.1 by @clairemcginty in #5969
- Update neo4j-java-driver to 4.4.26 by @clairemcginty in #5972
- Update metrics-core to 4.2.39 by @clairemcginty in #5968
- Update munit to 1.3.3 by @clairemcginty in #5975
- Update sbt, sbt-dependency-tree, ... to 1.12.13 by @clairemcginty in #5974
- Update sbt-scalafix to 0.14.7 by @clairemcginty in #5959
- Update sbt-api-mappings to 3.0.3 by @clairemcginty in #5966
- Update scalafmt-core to 3.11.1 by @clairemcginty in #5976
- Update scalac-options to 0.1.11 by @clairemcginty in #5978
Full Changelog: v0.15.9...v0.15.10
Contributors
shnapz, clairemcginty, and dependabot