Skip to content

v0.2.0

Choose a tag to compare

@HyukjinKwon HyukjinKwon released this 10 Jun 10:38
· 20 commits to main since this release

Adds Structured Streaming and Declarative Pipelines (Spark 4.1+), plus
temporary views, the catalog create_table family, new_session / interrupts /
operation tags, and assorted DataFrame additions (with_watermark,
repartition_by_range, checkpoint, col_regex, to_json, ...). Regenerated
against the Spark Connect 4.1.0 protocol.

Published to RubyGems: https://rubygems.org/gems/spark-connect/versions/0.2.0

See CHANGELOG.md for the full list. Not yet supported: UDFs, foreach/foreachBatch,
and MLlib-over-Connect.

Full Changelog: v0.1.0...v0.2.0